Visual facilitation of auditory localization in schoolchildren: A signal detection analysis

Warren (1970) has claimed that there are visual facilitation effects on auditory localization in adults but not in children. He suggests that a “visual map” organizes spatial information and that considerable experience of correlated auditory and visual events is necessary before normal spatial perception is developed. In the present experiment, children in Grades 1, 4, and 7 had to identify the position, right or left, of a single tone either blindfolded or with their eyes open. Analysis of the proportion of area under the ROC curve (obtained using reaction times) in the respective conditions showed that Ss were more sensitive to auditory position when vision was available. Reaction time was also generally faster in the light. I argue that the increase in sensitivity in the light represents updating of auditory position memory by voluntary eye movement. In the dark, eye movements are subject to involuntary and unperceived drift, which would introduce noise into the eye control mechanism and hence into auditory spatial memory.     

Effect of interval between auditory and preceding visual stimuli on auditory sensitivity

Auditory thresholds were determined by a modified method of limits, in introverts, ambiverts and extraverts, under three intensities of light. Five determinations were made: one before, one during and three (30 sec., c. 8 and 16 min.) after the light stimulation. An analysis of variance of the data showed significant results for the interval conditions, the personality type and the interaction of these parameters, under the weak light. Interval effects were also significant under medium and strong light. A weak light increased, and a strong light decreased, auditory sensitivity when threshold determinations began 30 sec., but not more than about 8 min., after the light stimulation, in introverts.     

Effect of intensity of visual stimulation on auditory sensitivity in relation to personality

Auditory thresholds were determined by a modified method of limits under 10 intensities of light (patterned or homogeneous). An analysis of variance of the data showed significant results for intensity conditions, personality type and the interaction of these parameters. Auditory sensitivity increased under weak, and decreased under strong, intensities of light in introverts. It increased under all intensities in extraverts, with greater increase at greater intensities, and increased under weak and medium intensities in ambiverts. The EPI E, but not N, scale scores and sensitivity increases correlated positively, at medium and strong intensities of light.     

Investigating the time course of tactile reflexive attention using a non-spatial discrimination task

Peripheral cues are thought to facilitate responses to stimuli presented at the same location because they lead to exogenous attention shifts. Facilitation has been observed in numerous studies of visual and auditory attention, but there have been only four demonstrations of tactile facilitation, all in studies with potential confounds. Three studies used a spatial (finger versus thumb) discrimination task, where the cue could have provided a spatial framework that might have assisted the discrimination of subsequent targets presented on the same side as the cue. The final study circumvented this problem by using a non-spatial discrimination; however, the cues were informative and interspersed with visual cues which may have affected the attentional effects observed. In the current study, therefore, we used a non-spatial tactile frequency discrimination task following a non-informative tactile white noise cue. When the target was presented 150 ms after the cue, we observed faster discrimination responses to targets presented on the same side compared to the opposite side as the cue; by 1000 ms, responses were significantly faster to targets presented on the opposite side to the cue. Thus, we demonstrated that tactile attentional facilitation can be observed in a non-spatial discrimination task, under unimodal conditions and with entirely non-predictive cues. Furthermore, we provide the first demonstration of significant tactile facilitation and tactile inhibition of return within a single experiment.     

Absolute sensitivity to white noise under auxiliary visual stimulation1

Absolute sensitivity to white noise was measured with the O in the dark, in constant illumination, and in the dark but with sound-synchronized flashes of light at three different intensities. A confidence rating procedure was used, and the results were analyzed in terms of the theory of signal detectability. There appeared to be no consistent effect of auxiliary visual stimulation on absolute auditory sensitivity for the four Os examined.     

Facilitation of responses by task-irrelevant complex deviant stimuli

Novel stimuli reliably attract attention, suggesting that novelty may disrupt performance when it is task-irrelevant. However, under certain circumstances novel stimuli can also elicit a general alerting response having beneficial effects on performance. In a series of experiments we investigated whether different aspects of novelty – stimulus novelty, contextual novelty, surprise, deviance, and relative complexity – lead to distraction or facilitation. We used a version of the visual oddball paradigm in which participants responded to an occasional auditory target. Participants responded faster to this auditory target when it occurred during the presentation of novel visual stimuli than of standard stimuli, especially at SOAs of 0 and 200 ms (Experiment 1). Facilitation was absent for both infrequent simple deviants and frequent complex images (Experiment 2). However, repeated complex deviant images did facilitate responses to the auditory target at the 200 ms SOA (Experiment 3). These findings suggest that task-irrelevant deviant visual stimuli can facilitate responses to an unrelated auditory target in a short 0–200 millisecond time-window after presentation. This only occurs when the deviant stimuli are complex relative to standard stimuli. We link our findings to the novelty P3, which is generated under the same circumstances, and to the adaptive gain theory of the locus coeruleus–norepinephrine system (Aston-Jones and Cohen, 2005), which may explain the timing of the effects.     

Sensation seeking and stimulus intensity as modulators of cortical,cardiovascular, and electrodermal response: A cross-modality study

Previous studies have related the trait of sensation seeking to augmenting of the evoked potential (EP) in both visual and auditory modalities and to electrodermal and heart rate (HR) orienting and defensive reactions. The present study examined all of these phenomena in the same sample of subjects in order to replicate previous findings, and investigate cross-modality consistency and relationships between cortical and peripheral responses. Fifty-four male subjects, scoring high or low on the Disinhibition Sensation Seeking Scale, were exposed to 4 intensities of auditory stimuli (tones) on one occasion and visual stimuli (light flash) on another. Two interstimulus (ISIs) intervals were used for each set of stimuli: first a 17 sec series, and then a 2 sec series. High disinhibitors showed EP augmenting and lows reducing on 3 of the 4 series; differences were significant on two of them. High disinhibitors showed stronger orienting (deceleratory) HR responses to visual and auditory stimuli while lows showed stronger defensive (acceleratory) HR responses. HR responses were significantly correlated across stimulus modalities. Auditory and visual EP slope measures were correlated only for the long ISI series.     

The co-occurrence of multisensory competition and facilitation

Previous studies of multisensory integration have often stressed the beneficial effects that may arise when information concerning an event arrives via different sensory modalities at the same time, as, for example, exemplified by research on the redundant target effect (RTE). By contrast, studies of the Colavita visual dominance effect (e.g., [Colavita, F. B. (1974). Human sensory dominance. Perception & Psychophysics, 16, 409–412]) highlight the inhibitory consequences of the competition between signals presented simultaneously in different sensory modalities instead. Although both the RTE and the Colavita effect are thought to occur at early sensory levels and the stimulus conditions under which they are typically observed are very similar, the interplay between these two opposing behavioural phenomena (facilitation vs. competition) has yet to be addressed empirically. We hypothesized that the dissociation may reflect two of the fundamentally different ways in which humans can perceive concurrent auditory and visual stimuli. In Experiment 1, we demonstrated both multisensory facilitation (RTE) and the Colavita visual dominance effect using exactly the same audiovisual displays, by simply changing the task from a speeded detection task to a speeded modality discrimination task. Meanwhile, in Experiment 2, the participants exhibited multisensory facilitation when responding to visual targets and multisensory inhibition when responding to auditory targets while keeping the task constant. These results therefore indicate that both multisensory facilitation and inhibition can be demonstrated in reaction to the same bimodal event.     

Effect of visual-verbal load and spatial compatibility on stimulus response

This study examined the effects of visual-verbalload (as measured by a visually presented reading-memory task with three levels) on a visual/auditory stimulus-response task. The three levels of load were defined as follows: "No Load" meant no other stimuli were presented concurrently; "Free Load" meant that a letter (A, B, C, or D) appeared at the same time as the visual or auditory stimulus; and "Force Load" was the same as "Free Load," but the participants were also instructed to count how many times the letter A appeared. The stimulus-response task also had three levels: "irrelevant," "compatible," and "incompatible" spatial conditions. These required different key-pressing responses. The visual stimulus was a red ball presented either to the left or to the right of the display screen, and the auditory stimulus was a tone delivered from a position similar to that of the visual stimulus. Participants also processed an irrelevant stimulus. The results indicated that participants perceived auditory stimuli earlier than visual stimuli and reacted faster under stimulus-response compatible conditions. These results held even under a high visual-verbal load. These findings suggest the following guidelines for systems used in driving: an auditory source, appropriately compatible signal and manual-response positions, and a visually simplified background.     

Audiovisual integration in noise by children and adults

The aim of this study was to investigate the development of multisensory facilitation in primary school-age children under conditions of auditory noise. Motor reaction times and accuracy were recorded from 8-year-olds, 10-year-olds, and adults during auditory, visual, and audiovisual detection tasks. Auditory signal-to-noise ratios (SNRs) of 30-, 22-, 12-, and 9-dB across the different age groups were compared. Multisensory facilitation was greater in adults than in children, although performance for all age groups was affected by the presence of background noise. It is posited that changes in multisensory facilitation with increased auditory noise may be due to changes in attention bias.     

On the role of eye movements and saccade preparation in generating auditory inhibition of return.

In three experiments, listeners were required to either localize or identify the second of two successive sounds. The first sound (the cue) and the second sound (the target) could originate from either the same or different locations, and the interval between the onsets of the two sounds (Stimulus Onset Asynchrony, SOA) was varied. Sounds were presented out of visual range at 135 azimuth left or right. In Experiment 1, localization responses were made more quickly at 100 ms SOA when the target sounded from the same location as the cue (i.e., a facilitative effect), and at 700 ms SOA when the target and cue sounded from different locations (i.e., an inhibitory effect). In Experiments 2 and 3, listeners were required to monitor visual information presented directly in front of them at the same time as the auditory cue and target were presented behind them. These two experiments differed in that in order to perform the visual task accurately in Experiment 3, eye movements to visual stimuli were required. In both experiments, a transition from facilitation at a brief SOA to inhibition at a longer SOA was observed for the auditory task. Taken together these results suggest that location-based auditory IOR is not dependent on either eye movements or saccade programming to sound locations.     

Orientation and lever responding in auditory discriminations in squirrel monkeys.

Head orientation during auditory discriminations was studies in squirrel monkeys using a two-lever trial-by-trial procedure. Animals were studied using auditory discriminations based on the position of the sound and on the spectral content differences between a pure tone and a noise. After the percentage of correct responses reached asymptote, head orientation was measured using videotape recordings. Orientation occurred on virtually every trial and was under the control of the position of the sound under all conditions. Lever responding was controlled by the same parameters of the sound under some conditions, and by different parameters in others. Orientation and lever responding were correlated (a level response could be predicted from the direction of orientation) when both responses were under the control of the same parameters of the sound. The two responses were uncorrelated when they were controlled by different parameters of the sound. Orientation and lever responding were not functionally related.     

Effects of auditory stimulus intensity on response force in simple, go/no-go, and choice RT tasks

In four experiments, increasing the intensities of both relevant and irrelevant auditory stimuli was found to increase response force (RF) in simple, go/no-go, and choice reaction time (RT) tasks. These results raise problems for models that localize the effects of auditory intensity on purely perceptual processes, indicating instead that intensity also affects motor output processes under many circumstances. In Experiment 1, simple RT, go/no-go, and choice RT tasks were compared, using the same stimuli for all tasks. Auditory stimulus intensity affected both RT and RF, and these effects were not modulated by task. In Experiments 2-4, an irrelevant auditory accessory stimulus accompanied a relevant visual stimulus, and the go/no-go and choice tasks were used. The intensity of the irrelevant auditory accessory stimulus was found to affect RT and RF, although the sizes of these effects depended somewhat on the temporal predictability of the accessory stimulus.     

Behavioral and electrophysiological measures of click audibility compared in the cat

Cats were trained to make an avoidance response to clicks in the presence of different levels of white masking noise. The audibility of the clicks at different masking intensities could be determined from the percentage of CRs made by the animals. Click-evoked responses were also recorded from the left inferior colliculus of each cat in the presence of several intensities of masking noise. The results showed that the noise level that just obscured the click-evoked response was quite close in intensity to the noise level that produced threshold click detection in the behavioral situation. While both behavioral and electrophysiological methods yielded similar measures of auditory sensitivity, the electrophysiological measure was obtained in a fraction of the time required to obtain the behavioral measure.     

On the role of bias in dissociated phonological priming effects: A reply to Goldinger (1999)

Phonological priming studies have revealed two dissociated effects: low-similarity facilitation and highsimilarity interference (Hamburger & Slowiaczek, 1996; Slowiaczek & Hamburger, 1992). Because these two effects are influenced by different variables, they most likely reflect different processes that occur during auditory word recognition. Goldinger (1999) suggests that one bias is responsible for all phonological priming effects. In this reply, we argue against such a position. Although low similarity facilitation is likely the product of this bias, the data on phonological priming indicate that the dissociated highsimilarity interference cannot be produced by the same mechanism. Instead, the data indicate that high-similarity interference may reflect lexical processes.     

The relationship between reaction time and intensity in discrete auditory tasks

The effect of signal intensity upon reaction time (RT) was studied in three auditory RT tasks in which the signal was a tone of high or low frequency. Experiment I showed the well-known negative gradient with intensity of simple RT when the subject was instructed to ignore the frequency and give the same response to both tones. But when the subject had to discriminate the frequency in a choice RT task, the RT/intensity relationship appeared to be U-shaped. Experiment II showed that when the subject was required to make a response to one signal but withhold it for the other, a task which requires discrimination of the frequency of the tone but removes the necessity to choose between overt responses, no increase in RT at high intensities was obtained. The results indicate that it is the response choice stage rather than the stimulus encoding stage which is retarded at higher energy levels. Experiment I also demonstrated that visual and auditory leading signals have similar facilitating effects without affecting the RT/intensity relationships.     

Extraversion and neuroticism in orienting reflex dishabituation

The present study examined the effects of extraversion (E) and neuroticism (N) as individual difference dimensions and of stimulus intensity on electrodermal orienting response habituation, test response, and dishabituation. Subjects were 162 college students selected from a screening sample of 860 as representing extreme groups of high, medium, and low E crossing with high, medium, and low N. Subjects in all nine resulting groups were habituated to criterion on auditory stimuli of 60, 80, and 100 db. A novel (test) stimulus and a dishabituating standard stimulus followed criteron habituation at each intensity. Results indicated that response amplitude for initial, test, and dishabituation responses was a direct function and that habituation rate (trials-to-criterion) was an inverse function of stimulus intensity. Extraverts habituated more rapidly than introverts at high intensity and gave smaller test and dishabituation responses. Some results differed when regression coefficients defined habituation rate and when first stimulus intensities alone were examined. Correlations among initial, test, and dishabituation responses and between each of these and the two measures of habituation rate are also reported. Results were interpreted as partially supportive of Eysenck's theory.     

Attention and personality in augmenting/reducing of visual evoked potentials

Earlier research has shown that extraverts tend to increase their visual evoked potential amplitudes with increasing light intensity (augmenting), while introverts reach their maximum amplitude at lower intensities (reducing). The evoked response has normally been measured from association areas of the brain (at the vertex). The present study measured VEP amplitudes over visual cortex and at the vertex, using four light intensities in two conditions, where attention was either directed towards the light stimuli, or away from them by a concurrent auditory task. Forty subjects were classified as extraverts or introverts based on the Eysenck Personality Inventory. The results show that attention interacted significantly with extraversion. Introverts exhibited a narrower focus of attention, while higher amplitudes and amplitude-intensity functions when attending to the light flashes and lower when distracted. Extraverts showed smaller differences between conditions, indicating a more evenly distributed attention. Higher arousal in introverts is the probable cause of their narrower focus of attention. There were marked differences in the distribution of activity between vertex and occipital cortex. Introverts showed relatively stronger occipital responses and extraverts stronger vertex responses across all intensities and in both conditions. The predisposition for mainly perceptual responses to aversive stimuli in introverts, and for general alerting and motor preparatory responses in extraverts, are interpreted as supportive of Brebner and Cooper's hypothesis that introverts are ‘geared to inspect’ and extraverts are ‘geared to respond’.     

The influence of eye movements and illumination on auditory localization

A critical analysis of a recent paper by Shelton and Searle (1980) on the visual facilitation of auditory localization is presented. The author claims that Shelton and Searle fail to make the relevant distinction between Warren’s (1970) frame of reference hypothesis and Jones’s (1975) spatial memory hypothesis. Shelton and Searle’s claim that they have demonstrated the existence of two distinct forms of visual facilitation is questioned. Data from an experiment in which auditory localization was tested under two levels of illumination (light and dark) and with two kinds of eye movement instructions (fixed and movement) are presented. The results show that facilitation occurs only when eye movements take place in a lighted environment. This is interpreted as supporting Warren’s frame of reference hypothesis.     

Ipsilateral inhibition and contralateral facilitation of simple reaction time to non-foveal visual targets from non-informative visual cues

Orienting to an extrafoveal light cue without foveating it induces a temporary inhibition of responses to subsequent targets presented in the same visual hemifield, as evinced from the fact that reaction time (RT) to targets ipsilateral to the cue relative to fixation is longer than RT to targets contralateral to the cue. This study has tested the hypothesis that ipsilateral RT inhibition is associated with contralateral RT facilitation by attempting to divide the difference between ipsilateral and contralateral RTs into costs and benefits. A neutral condition suited to this purpose should involve a cue that does not require a lateral orientation. Such neutral condition was provided by measuring RT to lateralized light targets following a central overhead auditory cue (experiment 1) or a foveal visual cue (experiment 2). In both experiments RT in the neutral condition was intermediate between ipsilateral and contralateral RTs, and the differences reaches significance in the second experiment. Benefits over the neutral condition measured in the contralateral condition were thus associated with costs in the ipsilateral condition. These results suggest that a reciprocal antagonism between opposite turning tendencies underlies the organization of covert orienting. They also agree with general multi-channel theories of selective attention according to which the facilitation of given channels is an obligatory accompaniment of the inhibition of other competing channels and vice versa.