Perception of the duration of auditory and visual stimuli in children and adults

This experiment investigated the effect of modality on temporal discrimination in children aged 5 and 8 years and adults using a bisection task with visual and auditory stimuli ranging from 200 to 800 ms. In the first session, participants were required to compare stimulus durations with standard durations presented in the same modality (within-modality session), and in the second session in different modalities (cross-modal session). Psychophysical functions were orderly in all age groups, with the proportion of long responses (judgement that a duration was more similar to the long than to the short standard) increasing with the stimulus duration, although functions were flatter in the 5-year-olds than in the 8-year-olds and adults. Auditory stimuli were judged to be longer than visual stimuli in all age groups. The statistical results and a theoretical model suggested that this modality effect was due to differences in the pacemaker speed of the internal clock. The 5-year-olds also judged visual stimuli as more variable than auditory ones, indicating that their temporal sensitivity was lower in the visual than in the auditory modality.     

Auditory/visual duration bisection in patients with left or right medial-temporal lobe resection

Patients with unilateral (left or right) medial temporal lobe lesions and normal control (NC) volunteers participated in two experiments, both using a duration bisection procedure. Experiment 1 assessed discrimination of auditory and visual signal durations ranging from 2 to 8 s, in the same test session. Patients and NC participants judged auditory signals as longer than equivalent duration visual signals. The difference between auditory and visual time discrimination was equivalent for the three groups, suggesting that a unilateral temporal lobe resection does not modulate the modality effect. To document interval-timing abilities after temporal lobe resection for different duration ranges, Experiment 2 investigated the discrimination of brief, 50-200 ms, auditory durations in the same patients. Overall, patients with right temporal lobe resection were found to have more variable duration judgments across both signal modality and duration range. These findings suggest the involvement of the right temporal lobe at the level of the decision process in temporal discriminations.     

Interval-timing deficits in individuals at high risk for schizophrenia

A duration-bisection procedure was used to study the effects of signal modality and divided attention on duration classification in participants at high genetic risk for schizophrenia (HrSz), major affective disorder (HrAff), and normal controls (NC). Participants learned short and long target durations during training and classified probe durations during test. All groups classified visual signals as shorter than equivalent duration auditory signals. However, the difference between auditory and visual signal classification was significantly larger for the HrSz group than for the NC group. We posit a model in which there is a clock rate difference between auditory and visual signals due to an attentional effect at the level of a mode switch that gates pulses into an accumulator. This attentionally mediated clock rate difference was larger for the HrSz participants than for the NC participants, resulting in a larger auditory/visual difference for the HrSz group.     

Auditory and visual differences in time perception? An investigation from a developmental perspective with neuropsychological tests

Adults and children (5- and 8-year-olds) performed a temporal bisection task with either auditory or visual signals and either a short (0.5-1.0s) or long (4.0-8.0s) duration range. Their working memory and attentional capacities were assessed by a series of neuropsychological tests administered in both the auditory and visual modalities. Results showed an age-related improvement in the ability to discriminate time regardless of the sensory modality and duration. However, this improvement was seen to occur more quickly for auditory signals than for visual signals and for short durations rather than for long durations. The younger children exhibited the poorest ability to discriminate time for long durations presented in the visual modality. Statistical analyses of the neuropsychological scores revealed that an increase in working memory and attentional capacities in the visuospatial modality was the best predictor of age-related changes in temporal bisection performance for both visual and auditory stimuli. In addition, the poorer time sensitivity for visual stimuli than for auditory stimuli, especially in the younger children, was explained by the fact that the temporal processing of visual stimuli requires more executive attention than that of auditory stimuli.     

Interference between auditory and visual duration judgements suggests a common code for time

Auditory stimuli usually have longer subjective durations than visual ones for the same real duration, although performance on many timing tasks is similar in form with different modalities. One suggestion is that auditory and visual stimuli are initially timed by different mechanisms, but later converted into some common duration code which is amodal. The present study investigated this using a temporal generalization interference paradigm. In test blocks, people decided whether comparison durations were or were not a 400-ms standard on average. Test blocks alternated with interference blocks where durations were systematically shorter or longer than in test blocks, and interference was found, in the direction of the durations in the interference blocks, even when the interfering blocks used stimuli in a different modality from the test block. This provides what may be the first direct experimental evidence for a “common code” for durations initially presented in different modalities at some level of the human timing system.     

Crossmodal duration perception involves perceptual grouping, temporal ventriloquism, and variable internal clock rates

Here, we investigate how audiovisual context affects perceived event duration with experiments in which observers reported which of two stimuli they perceived as longer. Target events were visual and/or auditory and could be accompanied by nontargets in the other modality. Our results demonstrate that the temporal information conveyed by irrelevant sounds is automatically used when the brain estimates visual durations but that irrelevant visual information does not affect perceived auditory duration (Experiment 1). We further show that auditory influences on subjective visual durations occur only when the temporal characteristics of the stimuli promote perceptual grouping (Experiments 1 and 2). Placed in the context of scalar expectancy theory of time perception, our third and fourth experiments have the implication that audiovisual context can lead both to changes in the rate of an internal clock and to temporal ventriloquism-like effects on perceived on- and offsets. Finally, intramodal grouping of auditory stimuli diminished any crossmodal effects, suggesting a strong preference for intramodal over crossmodal perceptual grouping (Experiment 5).     

Modality differences in timing and temporal memory throughout the lifespan

The perception of time is heavily influenced by attention and memory, both of which change over the lifespan. In the current study, children (8 yrs), young adults (18–25 yrs), and older adults (60–75 yrs) were tested on a duration bisection procedure using 3 and 6-s auditory and visual signals as anchor durations. During test, participants were exposed to a range of intermediate durations, and the task was to indicate whether test durations were closer to the “short” or “long” anchor. All groups reproduced the classic finding that “sounds are judged longer than lights”. This effect was greater for older adults and children than for young adults, but for different reasons. Replicating previous results, older adults made similar auditory judgments as young adults, but underestimated the duration of visual test stimuli. Children showed the opposite pattern, with similar visual judgments as young adults but overestimation of auditory stimuli. Psychometric functions were analyzed using the Sample Known Exactly-Mixed Memory quantitative model of the Scalar Timing Theory of interval timing. Results indicate that children show an auditory-specific deficit in reference memory for the anchors, rather than a general bias to overestimate time and that aged adults show an exaggerated tendency to judge visual stimuli as “short” due to a reduction in the availability of controlled attention.     

Duration judgments of naturalistic events in the auditory and visual modalities

Two experiments were performed to examine whether the same underlying mechanisms apply to the duration estimates of both auditory and visual events. In Experiment 1, it was found that the durations of visual scenes are reproduced with the same level of accuracy in prospective and retrospective situations when these display a predictable array of information, a result consistent with past research on auditory durations. Experiment 2 further revealed that when participants are asked to prospectively or retrospectively judge the durations of various naturalistic events in their auditory, visual, or audiovisual modality, no differences in either accuracy or bias are observed. These findings diverge from previous research and are argued to stem from different processing mechanisms that arise from naturalistic events.     

Stimulus spacing effects in duration perception are larger for auditory stimuli: Data and a model

Models of duration bisection have focused on the effects of stimulus spacing and stimulus modality. However, interactions between stimulus spacing and stimulus modality have not been examined systematically. Two duration bisection experiments that address this issue are reported. Experiment 1 showed that stimulus spacing influenced the classification of auditory, but not visual, stimuli. Experiment 2 used a wider stimulus range, and showed stimulus spacing effects for both visual and auditory stimuli, although the effects were larger for auditory stimuli. A version of Temporal Range Frequency Theory was applied to the data, and was used to demonstrate that the qualitative pattern of results can be captured with the single assumption that the durations of visual stimuli are less discriminable from one another than are the durations of auditory stimuli.     

When do auditory/visual differences in duration judgements occur?

Four experiments examined judgements of the duration of auditory and visual stimuli. Two used a bisection method, and two used verbal estimation. Auditory/visual differences were found when durations of auditory and visual stimuli were explicitly compared and when durations from both modalities were mixed in partition bisection. Differences in verbal estimation were also found both when people received a single modality and when they received both. In all cases, the auditory stimuli appeared longer than the visual stimuli, and the effect was greater at longer stimulus durations, consistent with a “pacemaker speed” interpretation of the effect. Results suggested that Penney, Gibbon, and Meck's (2000) “memory mixing” account of auditory/visual differences in duration judgements, while correct in some circumstances, was incomplete, and that in some cases people were basing their judgements on some preexisting temporal standard.     

Les effets de la modalité sensorielle sur la perception du temps

The subjective duration of an event can be influenced by the modality of the signal demarcating that event. For example, auditory signals are often judged as of longer duration than equivalent duration visual signals. Within the framework of pacemaker-accumulator models of timing, such modality effects raise the question of whether the internal clock is modality specific or amodal. The answer to this question is quite important for the development of cognitively and neurologically realistic models of timing and time perception. Here, we argue that the internal clock has both modality specific and amodal components. Specifically, we claim there is a common amodal pacemaker, but the switch-accumulator systems are modality specific. Moreover, we also posit that long-term memory representations of duration are stored amodally.     

When do auditory/visual differences in duration judgements occur?

Four experiments examined judgements of the duration of auditory and visual stimuli. Two used a bisection method, and two used verbal estimation. Auditory/visual differences were found when durations of auditory and visual stimuli were explicitly compared and when durations from both modalities were mixed in partition bisection. Differences in verbal estimation were also found both when people received a single modality and when they received both. In all cases, the auditory stimuli appeared longer than the visual stimuli, and the effect was greater at longer stimulus durations, consistent with a “pacemaker speed” interpretation of the effect. Results suggested that Penney, Gibbon, and Meck's (2000) “memory mixing” account of auditory/visual differences in duration judgements, while correct in some circumstances, was incomplete, and that in some cases people were basing their judgements on some preexisting temporal standard.     

Sensory effects on judgments of short time-intervals

Two experiments were conducted to test the effect of nontemporal factors on duration discrimination. In Exp. 1, a forced-choice adaptive procedure with a standard duration of 400 or 800 ms was employed. It was shown that, for both auditory and visual modes, the discrimination is better with empty intervals (a silent period between two brief signals) than with filled intervals (a continuous signal), but only with shorter durations. In a second experiment, where intervals of the same duration range were employed but were presented with a single-stimulus method, discrimination was better with empty than with filled intervals, and this effect applied to both ranges of duration and both sensory modes. In both experiments, discrimination was better in the auditory than in the visual mode. These data are discussed in the context of current models of timing mechanisms. Received: 16 October 1997 / Accepted: 30 April 1998     

Audition dominates vision in duration perception irrespective of salience,attention, and temporal discriminability

Whereas the visual modality tends to dominate over the auditory modality in bimodal spatial perception, the auditory modality tends to dominate over the visual modality in bimodal temporal perception. Recent results suggest that the visual modality dominates bimodal spatial perception because spatial discriminability is typically greater for the visual than for the auditory modality; accordingly, visual dominance is eliminated or reversed when visual-spatial discriminability is reduced by degrading visual stimuli to be equivalent or inferior to auditory spatial discriminability. Thus, for spatial perception, the modality that provides greater discriminability dominates. Here, we ask whether auditory dominance in duration perception is similarly explained by factors that influence the relative quality of auditory and visual signals. In contrast to the spatial results, the auditory modality dominated over the visual modality in bimodal duration perception even when the auditory signal was clearly weaker, when the auditory signal was ignored (i.e., the visual signal was selectively attended), and when the temporal discriminability was equivalent for the auditory and visual signals. Thus, unlike spatial perception, where the modality carrying more discriminable signals dominates, duration perception seems to be mandatorily linked to auditory processing under most circumstances.     

Division of attention between simultaneous and successive nonverbal signals varying in discriminability

Impaired performance indexed by accuracy usually accompanies the division of attention between simultaneous difficult signals. Presenting the signals successively reduces the impairment. Presenting easy signals eliminates it. Both variables crucial to these findings, relative time of onset and discriminability, were manipulated in the first experiment using a two-choice recognition paradigm involving bimodal signals. The results showed that, when a difficult signal was followed by two simultaneous easy ones, in a different modality from the first, performance was significantly worse on each than on the same signals presented alone. Simultaneous presentation of all three signals further increased the impairment for the difficult signal, but not for the easy ones. In the second experiment, the discriminability of the following signals was varied. The results showed, that when a difficult signal was followed by either two simultaneous easy signals, in a different modality from the first, or by two difficult ones, performance was significantly worse than on the same difficult signal presented alone. Further, when the preceding difficult signal was auditory, but not when it was visual, performance was better with easy following signals than with difficult ones. It is argued that an adequate account of the results from the two experiments requires the following assumptions concerning the processing of multiple signals: (1) a loss associated both with the acquisition and the storage of information, (2) preferential processing of visual signals over auditory ones. Proposals are made for the incorporation of both assumptions into a single model of divided attention.     

Duration discrimination by musicians and nonmusicians

This study investigated the effects of stimulus modality, standard duration, sex, and laterality in duration discrimination by musicians and nonmusicians. Seventeen musicians (M age = 24.1 yr.) and 22 nonmusicians (M age = 26.8 yr.) participated. Auditory (1,000 Hz) and tactile (250 Hz) sinusoidal suprathreshold stimuli with varying durations were used. The standard durations tested were 0.5 and 3.0 sec. Participants discriminated comparison stimuli which had durations slightly longer and shorter than the standard durations. Difference limens were found by the method of limits and converted to Weber fractions based on the standard durations. Musicians had lower, i.e., better, Weber fractions than nonmusicians in the auditory modality, but there was no significant difference between musicians and nonmusicians in the tactile modality. Auditory discrimination was better than tactile discrimination. Discrimination improved when the standard duration was increased both for musicians and nonmusicians. These results support previous findings of superior auditory processing by musicians. Significant differences between discrimination in the millisecond and second ranges may be due to a deviation from Weber's law and the discontinuity of timing in different duration ranges reported in the literature.     

Good vibrations: Human interval timing in the vibrotactile modality

This article reports a detailed examination of timing in the vibrotactile modality and comparison with that of visual and auditory modalities. Three experiments investigated human timing in the vibrotactile modality. In Experiment 1, a staircase threshold procedure with a standard duration of 1,000 ms revealed a difference threshold of 160.35 ms for vibrotactile stimuli, which was significantly higher than that for auditory stimuli (103.25 ms) but not significantly lower than that obtained for visual stimuli (196.76 ms). In Experiment 2, verbal estimation revealed a significant slope difference between vibrotactile and auditory timing, but not between vibrotactile and visual timing. That is, both vibrations and lights were judged as shorter than sounds, and this comparative difference was greater at longer durations than at shorter ones. In Experiment 3, performance on a temporal generalization task showed characteristics consistent with the predications of scalar expectancy theory (SET: Gibbon, 1977) with both mean accuracy and scalar variance exhibited. The results were modelled using the modified Church and Gibbon model (MCG; derived by Wearden, 1992, from Church & Gibbon 1982). The model was found to give an excellent fit to the data, and the parameter values obtained were compared with those for visual and auditory temporal generalization. The pattern of results suggest that timing in the vibrotactile modality conforms to SET and that the internal clock speed for vibrotactile stimuli is significantly slower than that for auditory stimuli, which is logically consistent with the significant differences in difference threshold that were obtained.     

Reduction of false recognition through haptic presentation of objects

False recognition of an item that is not presented (the lure) can occur when participants study and are tested on their recognition of items related to the lure. False recognition is reduced when the study and test modalities are congruent (e.g., both visual) rather than different (e.g., visual study and auditory test). The present study examined whether such a congruency effect occurs for haptic and auditory modalities. After studying items presented haptically or auditorily, participants took a haptic or auditory recognition test. False recognition was reduced when both the study and test were haptic, but not when the study was auditory and the test was haptic. These results indicate that cues encoded through the haptic modality can reduce false recognition.     

The effect of Parkinson's disease on time estimation as a function of stimulus duration range and modality

The present research sought to investigate the role of the basal ganglia in timing of sub- and supra-second intervals via an examination of the ability of people with Parkinson's disease (PD) to make temporal judgments in two ranges, 100-500 ms, and 1-5 s. Eighteen non-demented medicated patients with PD were compared with 14 matched controls on a duration-bisection task in which participants were required to discriminate auditory and visual signal durations within each time range. Results showed that patients with PD exhibited more variable duration judgments across both signal modality and duration range than controls, although closer analyses confirmed a timing deficit in the longer duration range only. The findings presented here suggest the bisection procedure may be a useful tool in identifying timing impairments in PD and, more generally, reaffirm the hypothesised role of the basal ganglia in temporal perception at the level of the attentionally mediated internal clock as well as memory retrieval and/or decision-making processes.     

The interaction between duration, velocity and repetitive auditory stimulation

Repetitive auditory stimulation (with click trains) and visual velocity signals both have intriguing effects on the subjective passage of time. Previous studies have established that prior presentation of auditory clicks increases the subjective duration of subsequent sensory input, and that faster moving stimuli are also judged to have been presented for longer (the time dilation effect). However, the effect of clicks on velocity estimation is unknown, and the nature of the time dilation effect remains ambiguous. Here were present a series of five experiments to explore these phenomena in more detail. Participants viewed a rightward moving grating which traveled at velocities ranging from 5 to 15°/s and which lasted for durations of 500 to 1500 ms. Gratings were preceded by clicks, silence or white noise. It was found that both clicks and higher velocities increased subjective duration. It was also found that the time dilation effect was a constant proportion of stimulus duration. This implies that faster velocity increases the rate of the pacemaker component of the internal clock. Conversely, clicks increased subjective velocity, but the magnitude of this effect was not proportional to actual velocity. Through considerations of these results, we conclude that clicks independently affect velocity and duration representations.