Spectral content as a cue to perceived auditory distance.

Changes in the spectral content of wide-band auditory stimuli have been repeatedly implicated as a possible cue to the distance of a sound source. Few of the previous studies of this factor, however, have considered whether the cue provided by spectral content serves as an absolute or a relative cue. That is, can differences in spectral content indicate systematic differences in distance even on their first presentation to a listener, or must the listener be able to compare sounds with one another in order to perceive some change in their distances? An attempt to answer this question and simultaneously to evaluate the possibly confounding influence of changes in the sound level and/or the loudness of the stimuli are described in this paper. The results indicate that a decrease in high-frequency content (as might physically be produced by passage through a greater amount of air) can lead to increases in perceived auditory distance, but only when compared with similar sounds having a somewhat different high-frequency content, ie spectral information can serve as a relative cue for auditory distance, independent of changes in overall sound level.     

Directional separation and the size cue to distance

Summary The effectiveness of the relative size cue to distance as a function of directional separation was investigated with the successive presentation of two luminous frames of the same shape but different visual angle. Either 0° or 180° of separation occurred between the successive presentations. In Exp. I the frames at 5 feet were viewed monocularly through a restrictive aperture. In Exp. II, the same frames were viewed monocularly through a lens such that the frames were at an accommodative distance of 100 feet. Reports of both the size and distance of the frames were obtained in each of the experiments. The results were analyzed in terms of the absolute size cue to distance occurring on the first presentations as well as the relative size cue to distance occurring between presentations. There was a tendency (not always statistically significant) to report the smaller frame at a farther distance than the larger frame, but only in Exp. II is there evidence that this tendency was greater on second than on first presentations. Therefore in Exp. II the relative size cue to distance was demonstrated to occur independently of the absolute size cue and it occurred at least as readily for the 180° as for the 0° separation between successive presentations. In both experiments the results from the size reports provide evidence for the presence of the relative size cue between successive presentations for both the 180° and 0° separations. It is concluded that the relative size cue is as effective when O must turn 180° to view the successive stimuli as when the successive stimuli are presented along the same line of sight. The procedure that is sometimes used of employing large directional separations in an attempt to avoid the relative size cue is, therefore, considered to be inappropriate. The results of the study were discussed in relation to a distinction between cognitive and perceptual processes in judgments of size and distance. Both the data of the present study and other results in the literature such as the size-distance paradox were analyzed in terms of a schema in which perceptual processes provided a basis for the rapid utilization of cognitive information.This investigation was supported by PHS Research Grant No. NS 08883, from the National Institute of Neurological Diseases and Strokes.     

Switching in the cocktail party: exploring intentional control of auditory selective attention

Using a novel variant of dichotic selective listening, we examined the control of auditory selective attention. In our task, subjects had to respond selectively to one of two simultaneously presented auditory stimuli (number words), always spoken by a female and a male speaker, by performing a numerical size categorization. The gender of the task-relevant speaker could change, as indicated by a visual cue prior to auditory stimulus onset. Three experiments show clear performance costs with instructed attention switches. Experiment 2 varied the cuing interval to examine advance preparation for an attention switch. Experiment 3 additionally isolated auditory switch costs from visual cue priming by using two cues for each gender, so that gender repetition could be indicated by a changed cue. Experiment 2 showed that switch costs decreased with prolonged cuing intervals, but Experiment 3 revealed that preparation did not affect auditory switch costs but only visual cue priming. Moreover, incongruent numerical categories in competing auditory stimuli produced interference and substantially increased error rates, suggesting continued processing of task-relevant information that often leads to responding to the incorrect auditory source. Together, the data show clear limitations in advance preparation of auditory attention switches and suggest a considerable degree of inertia in intentional control of auditory selection criteria.     

Exploring temporal dissipation of attention settings in auditory task switching

Using a cued auditory task-switching variant of dichotic listening, we varied the response–cue interval (RCI) to examine temporal dissipation effects. On each trial, participants were presented with two different number words, one spoken by a female speaker and another by a male speaker (dichotic listening), that served as competing targets for a numerical judgment. The gender of the task-relevant speaker was indicated by a visual task cue prior to each trial. Experiment 1A used two different cues for each task (i.e., gender) and showed only small cue repetition benefits (same cue vs. alternate cue) but large auditory switch costs (alternate cue vs. task switch). A replication without immediate cue repetitions (Experiment 1B) showed very similar switch costs, suggesting that immediate cue repetitions play a negligible role for the size of auditory task switch costs. Moreover, switch costs were reduced when the (entirely task-irrelevant) location of the task-relevant speaker changed, relative to when it was unchanged, suggesting an episodic feature-binding component in our dichotic-listening task. Importantly, both experiments showed no effect of RCI on auditory switch costs. Because statistical power for this null effect was reasonably high across experiments (n?=?50), this finding suggests that auditory attention settings do not dissipate quickly over time.     

Failure of familiar size to determine a metric for visually perceived distance

The use of knowledge of the familiar sizes of objects in determining the apparent distances of those objects is known as the familiar size cue to distance. If effective, this cue might be one of the factors responsible for supplying the metric (scalar) characteristics of perceptions of spatial extent within a visual display in which other information concerning scalar extents has been reduced to a minimum. Two groups of observers were presented with realistic objects of the same angular, but different assumed, sizes presented in such a cue-restricted display. Perceptions of size and distance within the display did not differ significantly as a function of the type of object initially presented. This result was consistent with the notion that scalar perceptions under these conditions probably are determined by a factor known as the specific distance tendency, rather than by the experiential factor of familiar size.     

On the role of eye movements and saccade preparation in generating auditory inhibition of return.

In three experiments, listeners were required to either localize or identify the second of two successive sounds. The first sound (the cue) and the second sound (the target) could originate from either the same or different locations, and the interval between the onsets of the two sounds (Stimulus Onset Asynchrony, SOA) was varied. Sounds were presented out of visual range at 135 azimuth left or right. In Experiment 1, localization responses were made more quickly at 100 ms SOA when the target sounded from the same location as the cue (i.e., a facilitative effect), and at 700 ms SOA when the target and cue sounded from different locations (i.e., an inhibitory effect). In Experiments 2 and 3, listeners were required to monitor visual information presented directly in front of them at the same time as the auditory cue and target were presented behind them. These two experiments differed in that in order to perform the visual task accurately in Experiment 3, eye movements to visual stimuli were required. In both experiments, a transition from facilitation at a brief SOA to inhibition at a longer SOA was observed for the auditory task. Taken together these results suggest that location-based auditory IOR is not dependent on either eye movements or saccade programming to sound locations.     

Look who's talking? Sound changes gaze behaviour in a dynamic social scene

Humans often look at other people in natural scenes, and previous research has shown that these looks follow the conversation and that they are sensitive to sound in audiovisual speech perception. In the present experiment, participants viewed video clips of four people involved in a discussion. By removing the sound, we asked whether auditory information would affect when speakers were fixated, how fixations between different observers were synchronized, and whether the eyes or mouth were looked at most often. The results showed that sound changed the timing of looks—by alerting observers to changes in conversation and attracting attention to the speaker. Clips with sound also led to greater attentional synchrony, with more observers fixating the same regions at the same time. However, looks towards the eyes of the people continued to dominate and were unaffected by removing the sound. These findings provide a rich example of multimodal social attention.     

Knowing what to look for: Voice affects face race judgements

The study examined the effect that auditory information (speaker language/accent: Japanese or French) had on the processing of visual information (the speaker's race: Asian or Caucasian) in two forced-choice tasks: Classification and perceptual judgement on animated talking characters. Two (male and female) sets of facial morphs were constructed such that a 3-D head of Caucasian appearance was gradually morphed (in 11 steps) into one of Asian appearance. Each facial morph was animated in association with spoken French/Japanese or English with a French/Japanese accent. To examine the auditory effect, each animation was played with or without sound. Experiment 1 used an Asian or Caucasian classification task. Results showed that faces heard in conjunction with Japanese or a Japanese accent were more likely to be classified as Asian compared to those presented without sound. Experiment 2 used a same or different judgement task. Results showed that accuracy was improved by hearing a Japanese accent compared to without sound. These results were discussed in terms of the voice information acting as a cue to assist in organizing and attending to face features.     

Intensity and reverberation as factors in the auditory perception of egocentric distance

Both auditory intensity and reverberation have previously been shown to be sufficient to produce systematically varying judgments of perceived distance when several values of the variable are presented repeatedly to the same observer. Such studies do not, however, indicate clearly whether these cues are functioning in an absolute or in a relative manner. An absolute cue to auditory distance would require that two groups presented with different values of the variable in question should report different values of perceived distance. Two experiments are reported in which intensity variation and reverberation are examined. The results showed that auditory intensity differences over a range of 20 dB did not serve as an absolute cue to auditory distance, but could serve as a strong cue to changes in such distance. A comparison of data obtained in a normally reverberatory setting (Experiment 1) and an anechoic chamber (Experiment 2) indicated that the state of reverberation could serve as an absolute cue, with greater reverberation being associated with greater perceived distances. Some of the results were discussed in terms of the possibility that the specific distance tendency (a concept developed to handle some phenomena in visual space perception) might have applicability to the study of auditory perceived distance as well.

     

The interaction of oculomotor cues and stimulus size in stereoscopic death constancy.

In the natural world, observers perceive an object to have a relatively fixed size and depth over a wide range of distances. Retinal image size and binocular disparity are to some extent scaled with distance to give observers a measure of size constancy. The angle of convergence of the two eyes and their accommodative states are one source of scaling information, but even at close range this must be supplemented by other cues. We have investigated how angular size and oculomotor state interact in the perception of size and depth at different distances. Computer-generated images of planar and stereoscopically simulated 3-D surfaces covered with an irregular blobby texture were viewed on a computer monitor. The monitor rested on a movable sled running on rails within a darkened tunnel. An observer looking into the tunnel could see nothing but the simulated surface so that oculomotor signals provided the major potential cues to the distance of the image. Observers estimated the height of the surface, their distance from it, or the stereoscopically simulated depth within it over viewing distances which ranged from 45 cm to 130 cm. The angular width of the images lay between 2 deg and 10 deg. Estimates of the magnitude of a constant simulated depth dropped with increasing viewing distance when surfaces were of constant angular size. But with surfaces of constant physical size, estimates were more nearly independent of viewing distance. At any one distance, depths appeared to be greater, the smaller the angular size of the image. With most observers, the influence of angular size on perceived depth grew with increasing viewing distance. These findings suggest that there are two components to scaling. One is independent of angular size and related to viewing distance. The second component is related to angular size, and the weighting accorded to it grows with viewing distance. Control experiments indicate that in the tunnel, oculomotor state provides the principal cue to viewing distance. Thus, the contribution of oculomotor signals to depth scaling is gradually supplanted by other cues as viewing distance grows. Binocular estimates of the heights and distances of planar surfaces of different sizes revealed that angular size and viewing distance interact in a similar way to determine perceived size and perceived distance.     

Perception of the relative distances of nearby sound sources

The pressure of a sound varies systematically with a listener's distance from a sound source, providing a useful cue for perceiving changes in the distance between a listener and a sound-producing object. The pressure-discrimination hypothesis predicts that thresholds for discriminating changes in distance are constrained by the underlying ability to discriminate the resulting changes in sound pressure--specifically, that the smallest discriminable change in distance should be about 5% of the reference distance. Previous studies reported thresholds of about 5% for reference distances greater than a few meters but surprisingly worse thresholds for closer reference distances. In the present study, thresholds at two close distances, 1 and 2 m, were within the 5% range predicted from the pressure-discrimination hypothesis. Moreover, thresholds were significantly worse in a control condition in which the pressure cue was removed. Results of previous studies were adjusted to take into account the possibility of conservative response tendencies by the subjects. These adjusted findings agree well with the results of the present study and the pressure-discrimination hypothesis. It is concluded that variations in sound pressure are very useful for perceiving changes in listener-source distances, even at close distances.     

Assessing auditory distance perception using perceptually directed action

Three experiments investigated auditory distance perception under natural listening conditions in a large open field. Targets varied in egocentric distance from 3 to 16 m. By presenting visual targets at these same locations on other trials, we were able to compare visual and auditory distance perception under similar circumstances. In some experimental conditions, observers made verbal reports of target distance. In others, observers viewed or listened to the target and then, without further perceptual information about the target, attempted to face the target, walk directly to it, or walk along a two-segment indirect path to it. The primary results were these. First, the verbal and walking responses were largely concordant, with the walking responses exhibiting less between-observer variability. Second, different motoric responses provided consistent estimates of the perceived target locations and, therefore, of the initially perceived distances. Third, under circumstances for which visual targets were perceived more or less correctly in distance using the more precise walking response, auditory targets were generally perceived with considerable systematic error. In particular, the perceived locations of the auditory targets varied only about half as much in distance as did the physical targets; in addition, there was a tendency to underestimate target distance, except for the closest targets.     

THE EFFECTS OF OBSERVER EXPECTATIONS,TASK AMBIGUITY,AND MEDIUM OF PRESENTATION ON LOW- AND HIGH-INFERENCE JUDGMENTS OF COMMUNICATIVE BEHAVIOR1

This study investigated the effects of observer expectations about a speaker's nonfluency level on nonfluency counts made during a taped speech and on post-performance evaluations of nonfluency, anxiety, central idea, organization, language, delivery, and general effectiveness. The influence of task ambiguity and medium of presentation on expectancy effects was also explored. Results indicate: (a) in a high-ambiguity condition, observers who expected a fluent speaker counted fewer nonfluencies in his speech than observers who expected a nonfluent speaker; (b) fluent-expectation observers rated the speaker more positively on the seven evaluative measures; (c) low task ambiguity eliminated expectancy effects on nonfluency counts and ratings of organization but not on the other six evaluative measures; and (d) auditory and auditory-visual presentations of the speech did not produce significant differences.     

Age-related deficits in guided search using cues

The ability of young and older adults to engage in guided conjunction search was tested in 2 experiments. In the cued condition, a picture of the target was presented before the search. In the noncued condition, there was no picture of the target. In Experiment 1, the cue was presented for 200 ms; the magnitude of the cuing effect (noncued response time--cued response time) was greater for the young than for the older observers. In Experiment 2 (older observers only), the cue duration was doubled, and older observers had a larger magnitude of cuing effect than found in Experiment 1 but not as large as what would be expected under generalized slowing. The results indicated that older observers had difficulty with interpreting the cue and setting search parameters when the target varied across trials.     

Slope of regard as a distance cue

It is proposed that some distance cues are learned when a perceptual parameter that varies with observation distance is regularly associated with objects whose distances are perceived because another distance cue operates. If that is the way distance cues can come into existence, it may be possible to identify a parameter that varies with distance but is not a known distance cue and to show that it functions as one. The slope of regard with which an object on the ground is viewed is such a potential distance cue. Its angle varies approximately with the reciprocal of distance. An experiment was done that showed that this slope angle functions as a distance cue. Subjects who looked through a device that altered slope angles gave estimates of the dimensions of an object on the ground. Perceived sizes, which vary inversely with distance, were found to be altered in accordance with the altered slope angle.     

Ontological issues in distance perception: cue use under full cue conditions cannot be inferred from use under controlled conditions

Phosphorescent square tiles (arranged to yield a single image size) were viewed in the dark by 56 monocular observers who utilized a chinrest. The targets were placed at one of three horizontal distances and at one of three eye heights, allowing us to study the relative effect of height in the visual field (HVF) and sagittal distance on observers' verbal reports of the horizontal distance at which the object lay (near, middle, or far). In Experiment 1, we found that reports covaried primarily with HVF and, as predicted, they exhibited a weak paradoxical inverse relation with horizontal distance. In a second and third experiment, a visible surface was placed under the targets at the three eye heights in both dark and fully lighted conditions. In this situation, the inverse distance relation disappeared, and HVF no longer influenced the judgments of most observers. The results show that information projected from relevant support surfaces is essential for veridical information about object distance. These results raise fundamental issues for perceptual researchers regarding how to decide when a cue has been properly delineated, given the assumption that the relation between a cue and what it specifies is probabilistic.     

Attention and action: The role of response mappings in auditory attention switching

Switching auditory attention incurs a performance decrement (i.e. auditory attention-switch costs). Using an auditory attention-switching paradigm, we aimed to generalise these across different response mappings. In all three experiments, two number words, spoken by a female and male speaker, were presented dichotically via headphones. A visual cue indicated the gender of the to-be-attended speaker in each trial. The task was a magnitude judgement of the relevant number word (i.e. smaller vs. larger than 5). We additionally varied the interval between cue onset and auditory stimulus onset (cue-stimulus interval) to explore cue-based preparatory effects. In Experiment 1, attention switching was more costly with direct-verbal responses (e.g. ‘smaller’) than in the shadowing task (e.g. ‘three’). In Experiment 2, performance was largely similar for direct-verbal responses and abstract-verbal responses (e.g. ‘left’). In Experiment 3, performance was generally worse with abstract-verbal responses than with abstract-manual responses (e.g. left key press) and auditory attention-switch costs were similar for both response mappings. Overall, auditory switch costs occurred more or less invariably across response mappings in categorical (magnitude) judgements suggesting a minor role of the response mapping in auditory attention switching. Furthermore, verbal identity-based judgements (i.e. shadowing) generally seem to benefit from ideomotor compatibility.     

Scene articulation: dependence of illuminant estimates on number of surfaces

The ability of observers to detect changes in illuminant over two scenes containing different random samples of reflecting surfaces was determined in an experiment with Mondrian-like patterns containing different numbers of coloured patches. Performance was found to improve as the number of patches increased from 9 to 49. In principle, observers could have used space-average scene colour as the cue ('grey-world' hypothesis) or the colour of the brightest surface in the scene ('bright-is-white' hypothesis), as the two cues generally covary. In a second experiment, observers matched illuminants across different patterns in which the space-average cue and the brightest-patch cue were independently manipulated. The articulation of the patterns was varied: the number of patches increased from 49 (patch width 1 deg visual angle) to over 50000 (patch width 0.03 deg), while the gamut of colours was held constant. Space-average colour was found to be the dominant cue with all patterns except for those with the largest patches.     

Auditory space perception in left- and right-handers

Several studies have shown that handedness has an impact on visual spatial abilities. Here we investigated the effect of laterality on auditory space perception. Participants (33 right-handers, 20 left-handers) completed two tasks of sound localization. In a dark, anechoic, and sound-proof room, sound stimuli (broadband noise) were presented via 21 loudspeakers mounted horizontally (from 80° on the left to 80° on the right). Participants had to localize the target either by using a swivel hand-pointer or by head-pointing. Individual lateral preferences of eye, ear, hand, and foot were obtained using a questionnaire. With both pointing methods, participants showed a bias in sound localization that was to the side contralateral to the preferred hand, an effect that was unrelated to their overall precision. This partially parallels findings in the visual modality as left-handers typically have a more rightward bias in visual line bisection compared with right-handers. Despite the differences in neural processing of auditory and visual spatial information these findings show similar effects of lateral preference on auditory and visual spatial perception. This suggests that supramodal neural processes are involved in the mechanisms generating laterality in space perception.     

A time-course analysis of attentional cueing by threatening scenes

Models of attention and emotion have assigned a special status to the processing of threatening information: Facilitated attentional capture by threat and its prioritized processing would allow for swift and adequate action to potentially dangerous stimuli. In four experiments, we examined the time-course of facilitated orienting of attention to threatening scenes in the exogenous cueing paradigm. Threat value and presentation duration of the cues were systematically varied. Facilitated attentional capture by threat was limited to highly threatening pictures presented for 100 ms. No attentional effects were observed with a 28 ms cue presentation duration. At slightly longer cue presentations, 200 ms and 500 ms, results indicated no and even reduced attentional capture by threat compared with neutral information. The present results provide support for the idea that threat facilitates fast attentional orienting to its location, followed by the inhibition of attention to threat.