Auditory accessory effects on visual processing

A series of experiments on intersensory facilitation demonstrates that non-informative sound of low to moderate intensity (30/80 dB) facilitates the reaction to a visual stimulus. By manipulating the preprocessing and perceptual stages of the visual signals, it appears that auditory intensity reduces choice reaction time independently from the positive influence of the intensity and duration of the visual imperative signal, but interacts with the effect of stimulus degradation. Degraded stimuli take more profit of the sound than intact stimuli. Besides a short-term activation effect, originated by accessories of the auditory modality, on the motor adjustment stage (cf. Sanders 1983), the results suggest that the accessory influences the stage of feature extraction.     

Effects of practice and signal energy on duration discrimination of brief auditory intervals

In Experiment 1, the proposition that duration discrimination of filled auditory intervals is based on temporal information rather than on energy-dependent cues was tested in 64 naive subjects. The subjects were presented with two auditory stimuli at different levels of intensity within one trial, and had to decide which of the two was longer in duration. An adaptive psychophysical procedure was used. As a measure of performance, difference threshold estimates in relation to a 50-msec standard interval were computed. Duration discrimination showed no effect of energy values, indicating that the subjects’ discrimination was independent of stimulus intensity. The goal of Experiments 2A and 2B was to investigate the effects of practice on duration discrimination which, in addition, may provide an indirect test for the potential use of energy-dependent cues. Effects of practice on duration discrimination of filled (Experiment 2 A) and empty (Experiment 2B) intervals were studied in 6 subjects in each case, over 20 testing sessions. An adaptive psychophysical procedure that was similar to the one used in Experiment 1 was applied. Neither short-term effects of practice based on the first five testing sessions, nor long-term effects of practice based on the means of 4 consecutive weeks, could be demonstrated. The results of the present study suggest that duration discrimination of brief auditory intervals is based on temporal information and not on stimulus energy. Furthermore, implications for the notion of a very basic bio-logical timing mechanism underlying temporal processing of brief auditory intervals in the range of milliseconds are discussed.     

Effect of visual-verbal load and spatial compatibility on stimulus response

This study examined the effects of visual-verbalload (as measured by a visually presented reading-memory task with three levels) on a visual/auditory stimulus-response task. The three levels of load were defined as follows: "No Load" meant no other stimuli were presented concurrently; "Free Load" meant that a letter (A, B, C, or D) appeared at the same time as the visual or auditory stimulus; and "Force Load" was the same as "Free Load," but the participants were also instructed to count how many times the letter A appeared. The stimulus-response task also had three levels: "irrelevant," "compatible," and "incompatible" spatial conditions. These required different key-pressing responses. The visual stimulus was a red ball presented either to the left or to the right of the display screen, and the auditory stimulus was a tone delivered from a position similar to that of the visual stimulus. Participants also processed an irrelevant stimulus. The results indicated that participants perceived auditory stimuli earlier than visual stimuli and reacted faster under stimulus-response compatible conditions. These results held even under a high visual-verbal load. These findings suggest the following guidelines for systems used in driving: an auditory source, appropriately compatible signal and manual-response positions, and a visually simplified background.     

Does increasing the warning signal intensity decrease or increase simple reaction time?

The purpose of the study was to reconcile the contradictory evidence reporting either a shortening or lengthening of the simple reaction time (RT) as a function of the intensity of a warning signal. The lengthening of auditory RT is obtained when short visual or auditory warning signals are of constant intensity within a session and succeeded by a fore-period. Visual RT did not vary under similar circumstances. There was no effect when a warning signal of constant intensity overlapped in time with the response stimulus. The shortening of RT occurred with auditory warning signals of variable intensity and overlapping in time with the response stimulus. The shortening of RT was interpreted as facilitation-by-arousal. The lengthening of RT is a contextual effect but the data do not support accounts based on sensory-neural adaptation or criterion changes.     

A constant error in the perception of brief temporal intervals

Ss were presented two stimuli of equal duration separated in time. The parrs of stimuli were vibrotactile, auditory, or visual. The Ss adjusted the time between the two stimuli to be equal to the duration of the first stimulus. The results show that for stimulus durations ranging from 100 to 1,200 msec, Ss set the tune between the two stimuli too long and by a constant amount. For vibrotactfle stimuli, the constant was 596 msec; for auditory stimuli, 657 msec; and for visual stimuli, 436 msec. Changing the intensity of the vibrotactile stimuli did not change the size of the constant error. When Ss were presented two tones with a burst of white noise between the tones and adjusted the duration of the white noise to be equal to the duration of the first tone, the white noise was not adjusted too long by a constant amount. The results suggest that there is a constant error in the perception of unfilled relative to filled temporal intervals.     

Effects of a violation of an expected increase or decrease in intensity on detection of change within an auditory pattern

An infrequent physical increase in the intensity of an auditory stimulus relative to an already loud frequently occurring “standard” is processed differently than an equally perceptible physical decrease in intensity. This may be because a physical increment results in increased activation in two different systems, a transient and a change detector system (signalling detection of an increase in transient energy and a change from the past, respectively). By contrast, a decrease in intensity results in increased activation in only the change detector system. The major question asked by the present study was whether a psychological (rather than a physical) increment would continue to be processed differently than a psychological decrement when both stimuli activated only the change detector system. Participants were presented with a sequence of 1000 Hz tones that followed a standard rule-based alternating high-low intensity pattern (LHLHLH). They were asked to watch a silent video and thus ignore the auditory stimuli. A rare “deviant” was created by repeating one of the stimuli (e.g., LHLHLLLH. The repetition of the high intensity stimulus thus acted as a relative, psychological increment compared to what the rule would have predicted (the low intensity); the repetition of the low intensity stimulus acted as a relative, psychological decrement compared to what the rule would have predicted (the high intensity). In different conditions, the intensity difference between the low and high intensity tones was either 3, 9 or 27 dB. A large MMN was elicited only when the separation between the low and high intensities was 27 dB. Importantly, this MMN peaked significantly earlier and its amplitude was significantly larger following presentation of the psychological increment. Thus, a deviant representing an increment in intensity relative to what would be predicted by the auditory past is processed differently than a deviant representing a decrement, even when activation of the transient detector system is controlled. The psychological increment did not however elicit a later positivity, the P3a, often thought to reflect the interruption of the central executive and a forced switching of attention.     

The effect of tone duration on auditory stream formation

In a study in which the effect of tone duration on the formation of auditory streams was investigated, subjects were presented with 15-sec alternating pure-tone sequences (ABAB …) and were asked to orient their attention over the duration of the sequence toward hearing either a temporally coherent or a segregated percept. At stimulus offset, the subjects indicated whether their percept at the end of the stimulus had been that of a temporally coherent ABAB trill or that of segregated A and B streams. The experimental results indicated that the occurrence of stream segregation increases as (1) the duration of the A and B tones increases in unison and (2) the difference in duration between the A and B tones increases, with the duration differences between the tones producing the strongest segregation effects. A comparison of these experimental results with those of other studies strongly suggests that the time interval between the offset and onset of consecutive tones in the same frequency range is the most important temporal factor affecting auditory stream formation. Furthermore, a simulation of the experimental results by the Beauvois and Meddis (1996) stream segregation model suggests that both the tone duration effects reported here and Gestalt auditory grouping on the basis of temporal proximity can be understood in terms of low-level neurophysiological processes and peripheral-channeling factors.     

Effect of classical conditioning on an internal clock

Six experiments with rats used a psychophysical choice procedure to study the internal clock used to discriminate duration. They investigated if the clock is sensitive to the signal value (associative strength) of a stimulus. The experiments involved two types of trials. On choice trials, a stimulus lasted a short (e.g., 3 s) or long (e.g., 12 s) duration; then the rats chose between two levers. The rewarded choice depended on the duration of the stimulus. On conditioning trials, the stimulus used on choice trials was presented, but it ended without food (extinction trials) or with food (pairing trials) regardless of what the rat did. The main stimulus minus accuracy with the long stimulus. Experiment 1 showed that extinction trials increased short bias relative to training without conditioning trials or to training with pairing trials. The rest of the experiments tested explanations of these results. The same results were found when extinction trials were the same duration as the short stimulus (Experiment 2), when extinction trials were a random duration (Experiment 5), and when the signal value of the conditioned stimulus was changed in another way (Experiment 6). The effect of conditioning trials was modality specific (Experiments 3 and 4). Of the explanations considered, the best one--the only one not contradicted at least once--is that changing the signal value of a stimulus changes how the clock times the stimulus. Reducing signal value reduces the measured duration.     

The foreperiod effect revisited

This paper explores four factors which could be important in accounting for the discrepant results which have previously been obtained with respect to the effect of foreperiod duration on reaction time (RT). In some studies a clear effect of foreperiod duration on auditory RT has been found, in contrast to a recent finding that foreperiod duration affected visual RT but not auditory RT. By means of two experiments, the effects of practice, time-on-task, reaction task (a-reaction versus selective reaction) and signal intensity were studied. The latter variable appears to be the principal determinant of the discrepant results in that there is an interaction between signal intensity, foreperiod duration and modality. The results fit the hypothesis that signals beyond a given intensity exert an immediate arousing effect which counteracts the foreperiod effect.     

Markers’ influence on the duration discrimination of intermodal intervals

The effects of sensory signal characteristics on the duration discrimination of intermodal intervals was investigated in three experiments. Temporal intervals were marked by either the successive presentation of a visual then auditory signal (VA), or by the successive presentation of an auditory then visual signal (AV). The results indicated that (1) VA intervals are generally easier to discriminate than are AV intervals, but this effect depends on the range of duration studied; (2) AV intervals are perceived as longer than VA intervals for durations ranging from 250 to 750 msec; (3) the intensity of the visual markers for both AV and VA intervals does not affect the discrimination; and (4) the perceived duration of an intermodal interval is influenced by the length of the first and second markers. The results are mainly interpreted in terms of (1) a sensory trace left by visual and auditory signals and (2) the detection of these signals.     

Prolonged development of auditory skills: A role for perceptual anchoring?

Many auditory skills continue to develop beyond infancy and even into adolescence, but the factors underlying this prolonged development remain poorly understood. Of interest here is the contribution of on-line statistical learning of stimulus repetitions (anchoring) to the development of auditory spectral and temporal discrimination, as well as the potential contributions of auditory attention and working memory. Children, aged 6–13 years, as well as adults (age range: 21–33 years) were tested on auditory frequency and duration discrimination. Each type of discrimination was measured in two conditions (XAB and XXXAB) designed to afford different levels of anchoring by varying the number of repetitions of a standard stimulus (X) prior to the presentation of the test tone (A or B) in each trial. Auditory attention and working memory were also assessed. Whereas duration and frequency discrimination in either condition did not reach adult level prior to 11 years of age, the magnitude of the anchoring effect was similar across ages. These data suggest that perceptual anchoring matures prior to the attainment of adult-like discrimination thresholds. Likewise, neither attention nor working memory could account for the observed developmental trajectories. That auditory discrimination and anchoring follow dissociable developmental trajectories suggests that different factors might contribute to the development of each. We therefore conclude that although anchoring might be necessary for attaining good auditory discrimination, it does not account for the prolonged development of auditory frequency and duration discrimination in school-aged children.     

Binding time: Evidence for integration of temporal stimulus features

Several lines of evidence suggest that during processing of events, the features of these events become connected via episodic bindings. Such bindings have been demonstrated for a large number of visual and auditory stimulus features, like color and orientation, or pitch and loudness. Importantly, most visual and auditory events typically also involve temporal features, like onset time or duration. So far, however, whether temporal stimulus features are also bound into event representations has never been tested directly. The aim of the present study was to investigate possible binding between stimulus duration and other features of auditory events. In Experiment 1, participants had to respond with two keys to a low or high pitch sinus tone. Critically, the tones were presented with two different presentation durations. Sequential analysis of RT data indicated binding of stimulus duration into the event representation: at pitch repetitions, performance was better when both pitch and duration repeated, relative to when only pitch repeated and duration switched. This finding was replicated with loudness as relevant stimulus feature in Experiment 2. In sum, the results demonstrate that temporal features are bound into auditory event representations. This finding is an important advancement for binding theory in general, and raises several new questions for future research.     

Effects of a violation of an expected increase or decrease in intensity on detection of change within an auditory pattern

An infrequent physical increase in the intensity of an auditory stimulus relative to an already loud frequently occurring “standard” is processed differently than an equally perceptible physical decrease in intensity. This may be because a physical increment results in increased activation in two different systems, a transient and a change detector system (signalling detection of an increase in transient energy and a change from the past, respectively). By contrast, a decrease in intensity results in increased activation in only the change detector system. The major question asked by the present study was whether a psychological (rather than a physical) increment would continue to be processed differently than a psychological decrement when both stimuli activated only the change detector system. Participants were presented with a sequence of 1000 Hz tones that followed a standard rule-based alternating high-low intensity pattern (LHLHLH). They were asked to watch a silent video and thus ignore the auditory stimuli. A rare “deviant” was created by repeating one of the stimuli (e.g., LHLHLLLH. The repetition of the high intensity stimulus thus acted as a relative, psychological increment compared to what the rule would have predicted (the low intensity); the repetition of the low intensity stimulus acted as a relative, psychological decrement compared to what the rule would have predicted (the high intensity). In different conditions, the intensity difference between the low and high intensity tones was either 3, 9 or 27 dB. A large MMN was elicited only when the separation between the low and high intensities was 27 dB. Importantly, this MMN peaked significantly earlier and its amplitude was significantly larger following presentation of the psychological increment. Thus, a deviant representing an increment in intensity relative to what would be predicted by the auditory past is processed differently than a deviant representing a decrement, even when activation of the transient detector system is controlled. The psychological increment did not however elicit a later positivity, the P3a, often thought to reflect the interruption of the central executive and a forced switching of attention.     

Change detection and off-frequency listening: A reply to Leshowitz and Wightman

Leshowitz and Wightman’s (1972) account of the fact that recognition of increments and decrements in intensity improves with signal duration relative to detection of increments and decrements is found wanting. Not only does their interpretation fail to explain the occurrence of the effect in several different stimulus situations, but it is inconsistent with the results of detection experiments in which either signal duration or the signal polarity is uncertain.     

Crossmodal attention switching: Auditory dominance in temporal discrimination tasks

Visual stimuli are often processed more efficiently than accompanying stimuli in another modality. In line with this “visual dominance”, earlier studies on attentional switching showed a clear benefit for visual stimuli in a bimodal visual–auditory modality-switch paradigm that required spatial stimulus localization in the relevant modality. The present study aimed to examine the generality of this visual dominance effect. The modality appropriateness hypothesis proposes that stimuli in different modalities are differentially effectively processed depending on the task dimension, so that processing of visual stimuli is favored in the dimension of space, whereas processing auditory stimuli is favored in the dimension of time. In the present study, we examined this proposition by using a temporal duration judgment in a bimodal visual–auditory switching paradigm. Two experiments demonstrated that crossmodal interference (i.e., temporal stimulus congruence) was larger for visual stimuli than for auditory stimuli, suggesting auditory dominance when performing temporal judgment tasks. However, attention switch costs were larger for the auditory modality than for visual modality, indicating a dissociation of the mechanisms underlying crossmodal competition in stimulus processing and modality-specific biasing of attentional set.     

Response force is sensitive to the temporal uncertainty of response stimuli

Three experiments examined whether temporal uncertainty about the delivery of a response stimulus affects response force in a simple reaction time (RT) situation. All experiments manipulated the foreperiod; that is, the interval between a warning signal and the response stimulus. In the constant condition, foreperiod length was kept constant over a block of trials but changed from block to block. In the variable condition, foreperiod length varied randomly from trial to trial. A visual warning and response stimulus were used in Experiment 1; response force decreased with foreperiod length in the variable condition, but increased in the constant condition. This result is consistent with the hypothesis that responses are less forceful when the temporal occurrence of the response stimulus is predictable. In a second experiment with an auditory warning signal and a response stimulus, response force was less sensitive to foreperiod manipulations. The third experiment manipulated both the modality and the intensity of the response signal and employed a tactile warning signal. This experiment indicated that neither the modality nor the intensity of the response signal affects the relation between response force and foreperiod length. An extension of Näätänen’s (1971) motor-readiness model accounts for the main results.     

The influence of stimulus properties on multisensory processing in the awake primate superior colliculus.

Multisensory integration is a process whereby information converges from different sensory modalities to produce a response that is different from that elicited by the individual modalities presented alone. A neural basis for multisensory integration has been identified within a variety of brain regions, but the most thoroughly examined model has been that of the superior colliculus (SC). Multisensory processing in the SC of anaesthetized animals has been shown to be dependent on the physical parameters of the individual stimuli presented (e.g., intensity, direction, velocity) as well as their spatial relationship. However, it is unknown whether these stimulus features are important, or evident, in the awake behaving animal. To address this question, we evaluated the influence of physical properties of sensory stimuli (visual intensity, direction, and velocity; auditory intensity and location) on sensory activity and multisensory integration of SC neurons in awake, behaving primates. Monkeys were trained to fixate a central visual fixation point while visual and/or auditory stimuli were presented in the periphery. Visual stimuli were always presented within the contralateral receptive field of the neuron whereas auditory stimuli were presented at either ipsi- or contralateral locations. Many of the SC neurons responsive to these sensory stimuli (n = 66/84; 76%) had stronger responses when the visual and auditory stimuli were combined at contralateral locations than when the auditory stimulus was located on the ipsilateral side. This trend was significant across the population of auditory-responsive neurons. In addition, some SC neurons (n = 31) were presented a battery of tests in which the quality of one stimulus of a pair was systematically manipulated. A small proportion of these neurons (n = 8/31; 26%) showed preferential responses to stimuli with specific physical properties, and these preferences were not significantly altered when multisensory stimulus combinations were presented. These data demonstrate that multisensory processing in the awake behaving primate is influenced by the spatial congruency of the stimuli as well as their individual physical properties.     

Detection and recognition of intensity changes in tone and noise: The detection-recognition disparity

Recognition of increments vs decrements in auditory intensity improves with signal duration, relative to detection of increments and decrements. This effect obtains whether the background stimulus is a tone, noise, or a tone with noise masker, and is largely uninfluenced by the rise time of the signals. These data are inconsistent with detection models in which the O makes only one sensory observation during each observation interval, but can be described in terms of a neural timing model in which transients play a critical role.     

Audition dominates vision in duration perception irrespective of salience,attention, and temporal discriminability

Whereas the visual modality tends to dominate over the auditory modality in bimodal spatial perception, the auditory modality tends to dominate over the visual modality in bimodal temporal perception. Recent results suggest that the visual modality dominates bimodal spatial perception because spatial discriminability is typically greater for the visual than for the auditory modality; accordingly, visual dominance is eliminated or reversed when visual-spatial discriminability is reduced by degrading visual stimuli to be equivalent or inferior to auditory spatial discriminability. Thus, for spatial perception, the modality that provides greater discriminability dominates. Here, we ask whether auditory dominance in duration perception is similarly explained by factors that influence the relative quality of auditory and visual signals. In contrast to the spatial results, the auditory modality dominated over the visual modality in bimodal duration perception even when the auditory signal was clearly weaker, when the auditory signal was ignored (i.e., the visual signal was selectively attended), and when the temporal discriminability was equivalent for the auditory and visual signals. Thus, unlike spatial perception, where the modality carrying more discriminable signals dominates, duration perception seems to be mandatorily linked to auditory processing under most circumstances.     

Controlled attention sharing influences time estimation

A seminal attentional model of time estimation predicts that subjective duration will be positively correlated to the amount of attention given to temporal processing. This prediction holds under prospective conditions, in which one is forewarned that judgments of time will be asked, in contrast to retrospective conditions, in which such judgments are required after the relevant period without any prior warning. In three experiments, an attention-sharing method was used. Subjects were asked to control the amount of attention that they devoted to one or the other component of a dual-task paradigm. The first experiment involved word categorization and reproduction of duration. The following experiments, based on signal detection theory, required discrimination of both the duration and the intensity of a single stimulus, in the visual (Experiment 2) or the auditory (Experiment 3) modality. The results indicate that when the attention is directly controlled by the subject, the subjective duration shortens as the amount of attention devoted to the temporal task diminishes. The implications of these results for the possible existence of an internal timer are considered.