Spectral cues provided by the pinna for monaural localization in the horizontal plane

Six subjects located, monaurally, 1.0-kHz-wide noise bursts whose source originated on the side of the functioning ear and whose center frequency ranged from 4.0 through 9.0 kHz (Part 1). Irrespective of their actual locations, the stimuli appeared to migrate from the frontal sector of the arc toward the side as the center frequency was increased above 4.0 kHz. For some subjects, the sounds appeared again in front at the higher center frequencies. Comparable data were obtained with noise bursts 2.0 kHz in width. We referred to these constellations of location judgments, influenced by the frequency composition of the stimuli, as spatial referent maps. In Part 2, we measured, by means of a miniature microphone placed at the entrance of the external ear canal, the pinna amplification function for these same stimuli emanating from the same locations. The results showed a positive relation between the apparent location of noise bursts centered at 6.0 kHz and above and the relative amplification provided by the pinna. Localization performances by two subjects, chosen on the basis of their noncorresponding spatial referent maps, were examined for stimuli of wider bandwidths IPart 3). Their proficiency differed markedly from one another, which we accounted for in terms of different spatial referent maps that were associated with differences in the pinna amplification function.     

The effects of attenuation of frequency segments on binaural localization of sound

Perceived location of tonal stimuli d narrow noise bands presented in two-dimensional space varies in an orderly manner with changes in stimulus frequency. Hence, frequency has a referent in space that is most apparent during monaural listening. The assumption underlying the present study is that maximum sound pressure level measured at the ear canal entrance for the various frequencies serves as a prominent spectral cue for their spatial referents. Even in binaural localization, location judgments in the vertical plane are strongly influenced by spatial referents. We measured sound pressure levels at the left ear canal entrance for 1.0-kHz-wide noise bands, centered from 4.0 kHz through 10.0 kHz, presented at locations from 60° through ?45° in the vertical plane; the horizontal plane coordinate was fixed at ?90°. On the basis of these measurements, we fabricated three different band-stop stimuli in which differently centered 2.0-kHz-wide frequency segments were filtered from a broadband noise. Unfiltered broadband noise served as the remaining stimulus. Localization accuracy differed significantly among stimulus conditions (p<.01). Where in the vertical plane most errors were made depended on which frequency segment was filtered from the broadband noise.     

Spectral cues which influence monaural Localization in the horizontal plane

An extensive series of behavioral tests was carried out to determine what region, or regions, of the sound spectrum were critical for locating sounds monaurally in the horizontal plane. Seven subjects were requested to locate narrow bands of noise centered at different frequencies, combinations of these noise bands, low-pass, high-pass, and broadband noise. As observed in an earlier study, increasing bandwidth did not necessarily lead to improved localization performance until the band became broad, including, for example, all frequencies above 4.0 kHz. What seems to be happening is that listeners perceive narrow bands of noise originating from restricted places in the horizontal plane which may differ one from another depending on the frequency composition of the stimulus. In several instances, if two noise bands were presented simultaneously, the resulting stimulus was located with reasonable accuracy provided each component, when presented singly, was perceived as emanating from clearly separate azimuthal positions. If, however, two noise bands, which were perceived to originate from approximately the same azimuthal position when presented singly, were now presented simultaneously, the resulting stimulus still was perceived to originate from the same region of the horizontal plane. This, then, is a case where augmenting the spectral content of the stimulus does not bring about improved performance. We suggest that the expression of judgmental biases in the apparent location of a band of noise may prove useful for understanding why some stimuli of specified width and center frequency are localizable while others are not.     

A comparison of the contrast effects in sound localization in the horizontal and vertical planes

The effect of a background sound on the auditory localization of a single sound source was examined. Nine loudspeakers were arranged crosswise in the horizontal and the median vertical plane. They ranged from -20 degrees to +20 degrees, with the center loudspeaker at 0 degree azimuth and elevation. Using vertical and horizontal centimeter scales, listeners verbally estimated the position of a 500-ms broadband noise stimulus being presented at the same time as a 2 s background sound, emitted by one of the four outer loudspeakers. When the background sound consisted of continuous broadband noise, listeners consistently shifted the apparent target positions away from the background sound locations. This auditory contrast effect, which is consistent with earlier findings, equally occurred in both planes. But when the background sound was changed to a pulse train of noise bursts, the contrast effect decreased in the horizontal plane and increased in the vertical plane. This discrepancy might be due to general differences in the processing of interaural and spectral localization information.     

The influence of stimulus bandwidth on localization of sound in space

The ability of listeners, deprived of prominent interaural time and intensity cues, to locate noise bands differing in width was investigated. To minimize binaural cues, we placed the sound source at various positions in the median sagittal plane. To eliminate binaural cues, we occluded one ear. The stimuli consisted of broadband noise and bands of noise centered at 8.0 kHz. The width of the latter ranged from 1.0 to 6.0 kHz. The results from seven listeners showed that localization proficiency for sounds in the median sagittal plane decreased with decreases in bandwidth for both binaural and monaural listening conditions. This function was less orderly for monaural localization of horizontally positioned sounds. Another consequence of a reduction in bandwidth was an increasing tendency of listeners to select certain loudspeakers over others as the source of the sound. A previous finding showing that localization of sound in the median sagittal plane is more accurate when listening binaurally rather than monaurally was confirmed.     

Automatic visual bias of perceived auditory location

Studies of reactions to audiovisual spatial conflict (alias “ventriloquism”) are generally presented as informing on the processes of intermodal coordination. However, most of the literature has failed to isolate genuine perceptual effects from voluntary postperceptual adjustments. A new approach, based on psychophysical staircases, is applied to the case of the immediate visual bias of auditory localization. Subjects have to judge the apparent origin of stereophonically controlled sound bursts as left or right of a median reference line. Successive trials belong to one of two staircases, starting respectively at extreme left and right locations, and are moved progressively toward the median on the basis of the subjects’ responses. Response reversals occur for locations farther away from center when a central lamp is flashed in synchrony with the bursts than without flashes (Experiment 1), revealing an attraction of the sounds toward the flashes. The effect cannot originate in voluntary postperceptual decision, since the occurrence of response reversal implies that the subject is uncertain concerning the direction of the target sound. The attraction is contingent on sound-flash synchronization, for early response reversals did no longer occur when the inputs from the two modalities were desynchronized (Experiment 2). Taken together, the results show that the visual bias of auditory localization observed repeatedly in less controlled conditions is due partly at least to an automatic attraction of the apparent location of sound by spatially discordant but temporally correlated visual inputs.     

Rapid adaptation to auditory-visual spatial disparity

The so-called ventriloquism aftereffect is a remarkable example of rapid adaptative changes in spatial localization caused by visual stimuli. After exposure to a consistent spatial disparity of auditory and visual stimuli, localization of sound sources is systematically shifted to correct for the deviation of the sound from visual positions during the previous adaptation period. In the present study, this aftereffect was induced by presenting, within 17 min, 1800 repetitive noise or pure-tone bursts in combination with synchronized, and 20° disparate flashing light spots, in total darkness. Post-adaptive sound localization, measured by a method of manual pointing, was significantly shifted 2.4° (noise), 3.1° (1 kHz tones), or 5.8° (4 kHz tones) compared with the pre-adaptation condition. There was no transfer across frequencies; that is, shifts in localization were insignificant when the frequencies used for adaptation and the post-adaptation localization test were different. It is hypothesized that these aftereffects may rely on shifts in neural representations of auditory space with respect to those of visual space, induced by intersensory spatial disparity, and may thus reflect a phenomenon of neural short-term plasticity.     

The aftereffects of ventriloquism: patterns of spatial generalization

We examined how visual recalibration of apparent sound location obtained at a particular location generalizes to untrained locations. Participants pointed toward the origin of tone bursts scattered along the azimuth, before and after repeated exposure to bursts in one particular location, synchronized with point flashes of light a constant distance to their left/right. Adapter tones were presented straight ahead in Experiment 1, and in the left or right periphery in Experiment 2. With both arrangements, different generalization patterns were obtained on the visual distractor's side of the auditory adapter and onthe opposite side. On the distractor side, recalibration generalized following a descending gradient; practically no generalization was observed on the other side. This dependence of generalization patterns on the direction of the discordance imposed during adaptation has not been reported before, perhaps because the experimental designs in use did not allow its observation.     

The ventriloquist effect does not depend on the direction of automatic visual attention.

Previously, we showed that the visual bias of auditory sound location, or ventriloquism, does not depend on the direction of deliberate, or endogenous, attention (Bertelson, Vroomen, de Gelder, & Driver, 2000). In the present study, a similar question concerning automatic, or exogenous, attention was examined. The experimental manipulation was based on the fact that exogenous visual attention can be attracted toward a singleton--that is, an item different on some dimension from all other items presented simultaneously. A display was used that consisted of a row of four bright squares with one square, in either the left- or the rightmost position, smaller than the others, serving as the singleton. In Experiment 1, subjects made dichotomous left-right judgments concerning sound bursts, whose successive locations were controlled by a psychophysical staircase procedure and which were presented in synchrony with a display with the singleton either left or right. Results showed that the apparent location of the sound was attracted not toward the singleton, but instead toward the big squares at the opposite end of the display. Experiment 2 was run to check that the singleton effectively attracted exogenous attention. The task was to discriminate target letters presented either on the singleton or on the opposite big square. Performance deteriorated when the target was on the big square opposite the singleton, in comparison with control trials with no singleton, thus showing that the singleton attracted attention away from the target location. In Experiment 3, localization and discrimination trials were mixed randomly so as to control for potential differences in subjects' strategies in the two preceding experiments. Results were as before, showing that the singleton attracted attention, whereas sound localization was shifted away from the singleton. Ventriloquism can thus be dissociated from exogenous visual attention and appears to reflect sensory interactions with little role for the direction of visual spatial attention.     

Auditory psychomotor coordination and visual search performance

In Experiments 1 and 2, the time to locate and identify a visual target (visual search performance in a two-alternative forced-choice paradigm) was measured as a function of the location of the target relative to the subject's initial line of gaze. In Experiment 1, tests were conducted within a 260 degree region on the horizontal plane at a fixed elevation (eye level). In Experiment 2, the position of the target was varied in both the horizontal (260 degrees) and the vertical (+/- 46 degrees from the initial line of gaze) planes. In both experiments, and for all locations tested, the time required to conduct a visual search was reduced substantially (175-1,200 msec) when a 10-Hz click train was presented from the same location as that occupied by the visual target. Significant differences in latencies were still evident when the visual target was located within 10 degrees of the initial line of gaze (central visual field). In Experiment 3, we examined head and eye movements that occur as subjects attempt to locate a sound source. Concurrent movements of the head and eyes are commonly encountered during auditorily directed search behavior. In over half of the trials, eyelid closures were apparent as the subjects attempted to orient themselves toward the sound source. The results from these experiments support the hypothesis that the auditory spatial channel has a significant role in regulating visual gaze.     

The monaural localization of tonal stimuli

With one ear occluded, 17 listeners were asked to locate tone bursts, .25, 4, .6, .9. l.4, 2.0, 3.2, 4.8, and 7.2 kHz, generated by a loudspeaker concealed from view. The S’s response was to callout that number, from a series of numbers arranged horizontally, behind which he thought the tone bursts originated. The listeners perceived the sounds as emanating from the side of the unoccluded ear, but their judgments bore no consistent relation to the actual location of the sound source. Rather, the listeners showed a strong tendency to locate a tone burst, within the range of .9 through 7.2 kHz, in a fixed spatial relation to the next higher- and lower-pitched tone burst. Distorting the pinna of the unoccluded ear failed to modify the perceptual pattern. It was suggested that the perceived spatial relations among the various frequencies was a by-product of the tonotopic organization of the auditory nervous system.     

Spatial orientation of a limb using egocentric reference points

Testing the hypothesis that spatial localization can be based on an abstracted spatial location code, rather than on stored proprioceptive information, orientation of an unseen limb was contrasted under intra- and interlimb-movement conditions. In Experiment 1, movements were executed in the midline either vertically upward or horizontally forward in the sagittal plane. These results revealed that intralimb errors were smaller than interlimb errors only at the most distant criterion spatial targets, and it was hypothesized that positioning of a limb could be mediated by a spatial location code if spatial targets were coded in association with body reference points. Experiment 2 tested the egocentric referent hypothesis further by manipulating the availability of body-based spatial reference points under intra- and interlimb conditions. At spatial targets that could be coded in conjunction with body reference points, no difference was found between intra- and interlimb accuracy. In contrast, at spatial targets where body reference points were absent, or at least made difficult to rely on, accuracy was greater in the intralimb condition. It was concluded that spatial reference points, in this instance body-based, are necessary if the spatial positioning of a limb is to be based on the spatial location code. The data were also discussed within a more comprehensive framework of spatial frames of reference.     

The ventriloquist effect does not depend on the direction of deliberate visual attention

It is well known that discrepancies in the location of synchronized auditory and visual events can lead to mislocalizations of the auditory source, so-called ventriloquism. In two experiments, we tested whether such cross-modal influences on auditory localization depend on deliberate visual attention to the biasing visual event. In Experiment 1, subjects pointed to the apparent source of sounds in the presence or absence of a synchronous peripheral flash. They also monitored for target visual events, either at the location of the peripheral flash or in a central location. Auditory localization was attracted toward the synchronous peripheral flash, but this was unaffected by where deliberate visual attention was directed in the monitoring task. In Experiment 2, bilateral flashes were presented in synchrony with each sound, to provide competing visual attractors. When these visual events were equally salient on the two sides, auditory localization was unaffected by which side subjects monitored for visual targets. When one flash was larger than the other, auditory localization was slightly but reliably attracted toward it, but again regardless of where visual monitoring was required. We conclude that ventriloquism largely reflects automatic sensory interactions, with little or no role for deliberate spatial attention.     

Does changing the reference frame affect infant categorization of the spatial relation BETWEEN?

Past research has shown that variation in the target objects depicting a given spatial relation disrupts the formation of a category representation for that relation. In the current research, we asked whether changing the orientation of the referent frame depicting the spatial relation would also disrupt the formation of a category representation for that relation. Experiments 1 to 3 provided evidence that 6- and 7-month-olds formed a category representation for BETWEEN when a diamond shape was depicted in different locations between two vertical or horizontal reference bars during familiarization and in a novel location between the same orientation of bars during test. By contrast, in Experiment 4, same-age infants did not form a category representation for BETWEEN when the diamond shape was depicted between two vertical (or horizontal) bars during familiarization and between two horizontal (or vertical) bars during test. Moreover, in Experiment 5, 9- and 10-month-olds did form a category representation for BETWEEN when the orientation of the referent bars depicting the relation changed from familiarization to test. The findings suggest that the formation of category representations for spatial relations by infants is affected by changes to either target (figure) or referent (ground).     

The linkage between stimulus frequency and covert peak areas as it relates to monaural localization

Head-related transfer functions for differently centered narrow noise bands were obtained on 6 subjects. Derived from these measurements were covert peak areas (CPAs), defined as the spatial constellation of loudspeakers that generates maximal sound pressure at the entrance of the ear canal for specific bands of frequency. On the basis of previous data, we proposed that different frequency bands served as important spectral cues for monaural localization of sounds from different loci and that location judgments were directed toward the CPAs associated with the different bands. In the first study, the stimuli were bandpass filtered so that they contained only those frequencies whose associated CPAs occupied either the monaural listener’s “upper” or “lower” spatial regions. Loudspeakers, separated by 15°, were stationed in the left hemifield, ranging from 0° to 180° azimuth and ?45° to 60° elevation. Subjects reported the loudspeaker from which the sound appeared to originate. Judgments of the sound’s elevation were in general accord with the CPAs associated with the different frequency segments. In the second study, monaural localization tests were administered in which different 2.0-kHz-wide frequency bands linked with specific CPAs were notch filtered from a 3.5-kHz highpass noise band. For the control condition, the highpass noise was unfiltered. The data demonstrated that filtering a frequency segment linked with specific CPAs resulted in significantly fewer location responses directed toward that particular spatial region. These results demonstrate in greater detail the relation between the directional filtering properties of the pinna and monaural localization of sound.     

The linkage between stimulus frequency and covert peak areas as it relates to monaural localization.

Head-related transfer functions for differently centered narrow noise bands were obtained on 6 subjects. Derived from these measurements were covert peak areas (CPAs), defined as the spatial constellation of loudspeakers that generates maximal sound pressure at the entrance of the ear canal for specific bands of frequency. On the basis of previous data, we proposed that different frequency bands served as important spectral cues for monaural localization of sounds from different loci and that location judgments were directed toward the CPAs associated with the different bands. In the first study, the stimuli were bandpass filtered so that they contained only those frequencies whose associated CPAs occupied either the monaural listener's "upper" or "lower" spatial regions. Loudspeakers, separated by 15 degrees, were stationed in the left hemifield, ranging from 0 degree to 180 degrees azimuth and -45 degrees to 60 degrees elevation. Subjects reported the loudspeaker from which the sound appeared to originate. Judgments of the sound's elevation were in general accord with the CPAs associated with the different frequency segments. In the second study, monaural localization tests were administered in which different 2.0-kHz-wide frequency bands linked with specific CPAs were notch filtered from a 3.5-kHz highpass noise band. For the control condition, the highpass noise was unfiltered. The data demonstrated that filtering a frequency segment linked with specific CPAs resulted in significantly fewer location responses directed toward that particular spatial region. These results demonstrate in greater detail the relation between the directional filtering properties of the pinna and monaural localization of sound.     

The impact of broadband noise on serial memory: changes in band-pass frequency increase disruption

Irrelevant sound consisting of bursts of broadband noise, in which centre frequency changes with each burst, markedly impaired short-term memory for order. In contrast, a sequence of irrelevant sound in which the same band-pass noise burst was repeated did not produce significant disruption. Serial recall for both visual-verbal (Experiment 1) and visual-spatial items (Experiment 2) was sensitive to the increased disruption produced by changing irrelevant noise. The results provide evidence that sounds that are largely aperiodic can produce marked disruption of serial recall in a similar manner to periodic sounds (e.g., speech, musical streams, and tones), and thus show a changing-state effect.     

The ventriloquist effect does not depend on the direction of automatic visual attention

Previously, we showed that the visual bias of auditory sound location, or ventriloquism, does not depend on the direction of deliberate, orendogenous, attention (Bertelson, Vroomen, de Gelder, & Driver, 2000). In the present study, a similar question concerning automatic, orexogenous, attention was examined. The experimental manipulation was based on the fact that exogenous visual attention can be attracted toward asingleton—that is, an item different on some dimension from all other items presented simultaneously. A display was used that consisted of a row of four bright squares with one square, in either the left- or the rightmost position,smaller than the others, serving as the singleton. In Experiment 1, subjects made dichotomous left-right judgments concerning sound bursts, whose successivelocations were controlled by a psychophysical staircase procedure and which were presented in synchrony with a display with the singleton either left or right. Results showed that the apparent location of the sound was attractednot toward the singleton, but instead toward the big squares at the opposite end of the display. Experiment 2 was run to check that the singleton effectively attracted exogenous attention. The task was to discriminate target letters presented either on the singleton or on the opposite big square. Performance deteriorated when the target was on the big square opposite the singleton, in comparison with control trials with no singleton, thus showing that the singleton attracted attention away from the target location. In Experiment 3, localization and discrimination trials were mixed randomly so as to control for potential differences in subjects’ strategies in the two preceding experiments. Results were as before, showing that the singleton attracted attention, whereas sound localization was shifted away from the singleton. Ventriloquism can thus be dissociated from exogenous visual attention and appears to reflect sensory interactions with little role for the direction of visual spatial attention.     

The gradient of spatial auditory attention in free field: An event-related potential study

Young adult subjects attended selectively to brief noise bursts delivered in free field via a horizontal array of seven loudspeakers spaced apart by 9° of angle. Frequent “standard” stimuli (90%) and infrequent “target/deviant” stimuli (10%) of increased bandwidth were delivered at a fast rate in a random sequence equiprobably from each speaker. In separate runs, the subjects’ task was to selectively attend to the leftmost, center, or rightmost speaker and to press a button to the infrequent “target” stimuli occurring at the designated spatial location. Behavioral detection rates and concurrently recorded event-related potentials (ERPs) indicated that auditory attention was deployed as a finely tuned gradient around the attended sound source, thus providing support for gradient models of auditory spatial attention. Furthermore, the ERP data suggested that the spatial focusing of attention was achieved in two distinct stages, with an early more broadly tuned filtering of inputs occurring over the first 80–200 msec after stimulus onset, followed by a more narrowly focused selection of attended-location deviants that began at around 250 msec and closely resembled the behavioral gradient of target detections.     

Correlations among within-channel and between-channel auditory gap-detection thresholds in normal listeners

We obtained data on within-channel and between-channel auditory temporal gap-detection acuity in the normal population. Ninety-five normal listeners were tested for gap-detection thresholds, for conditions in which the gap was bounded by spectrally identical, and by spectrally different, acoustic markers. Separate thresholds were obtained with the use of an adaptive tracking method, for gaps delimited by narrowband noise bursts centred on 1.0 kHz, noise bursts centred on 4.0 kHz, and for gaps bounded by a leading marker of 4.0 kHz noise and a trailing marker of 1.0 kHz noise. Gap thresholds were lowest for silent periods bounded by identical markers--'within-channel' stimuli. Gap thresholds were significantly longer for the between-channel stimulus--silent periods bounded by unidentical markers (p < 0.0001). Thresholds for the two within-channel tasks were highly correlated (R = 0.76). Thresholds for the between-channel stimulus were weakly correlated with thresholds for the within-channel stimuli (1.0 kHz, R = 0.39; and 4.0 kHz, R = 0.46). The relatively poor predictability of between-channel thresholds from the within-channel thresholds is new evidence on the separability of the mechanisms that mediate performance of the two tasks. The data confirm that the acuity difference for the tasks, which has previously been demonstrated in only small numbers of highly trained listeners, extends to a population of untrained listeners. The acuity of the between-channel mechanism may be relevant to the formation of voice-onset time-category boundaries in speech perception.