Time perception and the internal clock: Effects of visual flicker on the temporal oscillator

Abstract

Our ability to estimate time intervals has sometimes been attributed to a biological source of temporal information. A model for a temporal oscillator that provides such information has recently been described (Treisman, Faulkner, Naish & Brogan, 1990). This predicts that an imposed stimulus rhythm at certain frequencies may interfere with the temporal oscillator so as to alter its frequency. This interference would cause perturbations in temporal judgements at certain frequencies of the imposed rhythm. The pattern of interference would depend on the frequency at which the temporal oscillator runs, and so would contain information about the oscillator frequency. Evidence for such a pattern was found when auditory clicks at different rates were presented concurrently with time intervals whose durations subjects estimated. The present study examines whether a similar interference pattern can be obtained if visual flicker is substituted for auditory clicks. On each trial, flicker was presented at a rate between 2.5 and 17.5 Hz, concurrently with a time interval to be estimated. A pattern of increased estimates at some rates and decreased estimates at others was obtained. This pattern showed similarities to interference patterns obtained using auditory clicks. This provides evidence that the entrainment of the internal clock predicted by the model can also be produced by visual inputs. Other theoretical implications are discussed.     

On the Relation Between Time Perception and the Timing of Motor Action: Evidence for a Temporal Oscillator Controlling the Timing of Movement

Studies of time estimation have provided evidence that human time perception is determined by an internal clock containing a temporal oscillator and have also provided estimates of the frequency of this oscillator (Treisman, Faulkner, Naish, & Brogan, 1992; Treisman & Brogan, 1992). These estimates were based on the observation that when the intervals to be estimated are accompanied by auditory clicks that recur at certain critical rates, perturbations in time estimation occur. To test the hypothesis that the mechanisms that underlie the perception of time and those that control the timing of motor performance are similar, analogous experiments were performed on motor timing, with the object of seeing whether evidence for a clock would be obtained and if so whether its properties resemble those of the time perception clock. The prediction was made that perturbations in motor timing would be seen at the same or similar critical auditory click rates. The experiments examined choice reaction time and typing. The results support the hypothesis that a temporal oscillator paces motor performance and that this oscillator is similar to the oscillator underlying time perception. They also provide an estimate of the characteristic frequency of the oscillator.     

The effects of intensity and interval rhythms on the perception of auditory and visual temporal patterns

Repeating temporal patterns were presented in the auditory and visual modalities so that: (a) all elements were of equal intensity and were equally spaced in time (uniform presentation); (b) the intensity of one element was increased (accent presentation); or (c) the interval between two elements was increased (pause presentation). Intensity and interval patterning serve to segment the element sequence into repeating patterns.

For uniform presentation, pattern organization was by pattern structure, with auditory identification being faster. For pause presentation, organization was by the pauses; both auditory and visual identification were twice as fast as for uniform presentation. For auditory accent presentation, organization was by pattern structure and identification was slower than for uniform presentation. In contrast, the organization of visual accent presentation was by accents and identification was faster than for uniform presentation. These results suggest that complex stimuli, in which elements are patterned along more than one sensory dimension, are perceptually unique and therefore their identification rests on the nature of each modality.     

The internal clock: evidence for a temporal oscillator underlying time perception with some estimates of its characteristic frequency

Evidence for the proposition that human time perception is determined by an internal clock is largely indirect. It would strengthen the case for this hypothesis if a model for the internal clock were available from which predictions could be derived and tested, and if the basic parameter of such a model, the frequency at which the clock runs, could be estimated. A model for an internal temporal pacemaker is briefly described and its properties are explored by computer simulation. Results are obtained that provide a basis for predicting that, under appropriate conditions, interference between an imposed rhythm and the frequency of a temporal oscillator may cause perturbations in temporal judgment which are related to the characteristic frequency of that oscillator. Experimental data are reported which appear to demonstrate such an interference pattern. These results allow some estimates of the characteristic frequency of the temporal oscillator to be obtained.     

Timing is everything: Changes in presentation rate have opposite effects on auditory and visual implicit statistical learning

Implicit statistical learning (ISL) is exclusive to neither a particular sensory modality nor a single domain of processing. Even so, differences in perceptual processing may substantially affect learning across modalities. In three experiments, statistically equivalent auditory and visual familiarizations were presented under different timing conditions that either facilitated or disrupted temporal processing (fast or slow presentation rates). We find an interaction of rate and modality of presentation: At fast rates, auditory ISL was superior to visual. However, at slow presentation rates, the opposite pattern of results was found: Visual ISL was superior to auditory. Thus, we find that changes to presentation rate differentially affect ISL across sensory modalities. Additional experiments confirmed that this modality-specific effect was not due to cross-modal interference or attentional manipulations. These findings suggest that ISL is rooted in modality-specific, perceptually based processes.     

Timing is everything: changes in presentation rate have opposite effects on auditory and visual implicit statistical learning

Implicit statistical learning (ISL) is exclusive to neither a particular sensory modality nor a single domain of processing. Even so, differences in perceptual processing may substantially affect learning across modalities. In three experiments, statistically equivalent auditory and visual familiarizations were presented under different timing conditions that either facilitated or disrupted temporal processing (fast or slow presentation rates). We find an interaction of rate and modality of presentation: At fast rates, auditory ISL was superior to visual. However, at slow presentation rates, the opposite pattern of results was found: Visual ISL was superior to auditory. Thus, we find that changes to presentation rate differentially affect ISL across sensory modalities. Additional experiments confirmed that this modality-specific effect was not due to cross-modal interference or attentional manipulations. These findings suggest that ISL is rooted in modality-specific, perceptually based processes.     

The interaction between duration, velocity and repetitive auditory stimulation

Repetitive auditory stimulation (with click trains) and visual velocity signals both have intriguing effects on the subjective passage of time. Previous studies have established that prior presentation of auditory clicks increases the subjective duration of subsequent sensory input, and that faster moving stimuli are also judged to have been presented for longer (the time dilation effect). However, the effect of clicks on velocity estimation is unknown, and the nature of the time dilation effect remains ambiguous. Here were present a series of five experiments to explore these phenomena in more detail. Participants viewed a rightward moving grating which traveled at velocities ranging from 5 to 15°/s and which lasted for durations of 500 to 1500 ms. Gratings were preceded by clicks, silence or white noise. It was found that both clicks and higher velocities increased subjective duration. It was also found that the time dilation effect was a constant proportion of stimulus duration. This implies that faster velocity increases the rate of the pacemaker component of the internal clock. Conversely, clicks increased subjective velocity, but the magnitude of this effect was not proportional to actual velocity. Through considerations of these results, we conclude that clicks independently affect velocity and duration representations.     

Figure and ground in space and time: 1. Temporal response surfaces of perceptual organization

The figure-ground organization of an ambiguous bipartite pattern can be manipulated by altering the temporal-frequency content of the two regions of the pattern. Ambiguous patterns in which the two regions of each pattern contained sine-wave gratings of either 8, 4, 1, or 0.5 cycles deg-1 undergoing contrast reversal at rates of 0, 3.75, 7.5, or 15 Hz were tested for figure-ground organization under conditions of equated space-averaged and time-averaged luminance and perceived contrast. All combinations of temporal-frequency differences between the two regions were tested at each spatial frequency. The data are reported for two levels of temporal resolution (15 and 30 s). The pattern region with the relatively higher temporal frequency tended to be seen as the background a higher percentage of the viewing time. There were significant linear trends for the appearance as background of the region of higher temporal frequency with respect to the magnitude of the temporal-frequency difference between the two regions of each pattern for all spatial frequencies and data intervals except the final 15 s interval of the lowest (0.5 cycle deg-1) spatial-frequency condition.     

Backward recognition masking as a general type of interference in needed poststimulus processing

Auditory backward recognition masking (ABRM) has been argued to reflect interference in the storage and/or processing of a short-lived sensory form of information and has been viewed as a relatively invariant attribute of auditory pitch processing for very brief stimuli that are minimally separated in frequency (DeltaF). In contrast, the present study demonstrates that ABRM reflects interference with several basic principles of auditory processing. Measured in terms of target tone duration, rather than DeltaF, ABRM is demonstrated for target stimuli representing the interval of a musical fifth and masker-target stimulus intervals of a musical third, with thresholds ranging from approximately 22 to 55 msec and psychometric functions that are indicative of more than one contributing factor. On the basis of common underlying principles, the possibility that the threshold for the identification of temporal order of onset reflects ABRM and possible implications for the perception of complex stimuli, including speech, are discussed.     

Synchronizing actions with events: The role of sensory information

Tasks requiring the subject to tap in synchrony to a regular sequence of stimulus events (e.g., clicks) usually elicit a response pattern in which the tap precedes the click by about 30-50 msec. This “negative asynchrony” was examined, first, by instructing subjects to use different effectors for tapping (hand vs. foot; Experiments 1 and 2), and second, by administering extrinsic auditory feedback in addition to the intrinsic tactile/kinesthetic feedback (Experiment 2). Experiment 3 controlled whether the results observed in Experiment 2 were due to purely sensory factors within the auditory modality. Results suggest that taps are synchronized with clicks at the central level by superimposing two sensory codes in time: the tactile/kinesthetic code that represents the tap (the afferent movement code) and the auditory code that represents the click (the afferent code that results from the guiding signal). Because the processing times involved in code generation are different for these two central codes, the tap has to lead over the click.     

Temporal expectation weights visual signals over auditory signals

Temporal expectation is a process by which people use temporally structured sensory information to explicitly or implicitly predict the onset and/or the duration of future events. Because timing plays a critical role in crossmodal interactions, we investigated how temporal expectation influenced auditory–visual interaction, using an auditory–visual crossmodal congruity effect as a measure of crossmodal interaction. For auditory identification, an incongruent visual stimulus produced stronger interference when the crossmodal stimulus was presented with an expected rather than an unexpected timing. In contrast, for visual identification, an incongruent auditory stimulus produced weaker interference when the crossmodal stimulus was presented with an expected rather than an unexpected timing. The fact that temporal expectation made visual distractors more potent and visual targets less susceptible to auditory interference suggests that temporal expectation increases the perceptual weight of visual signals.     

Brainstem correlates of temporal auditory processing in children with specific language impairment

Deficits in identification and discrimination of sounds with short inter-stimulus intervals or short formant transitions in children with specific language impairment (SLI) have been taken to reflect an underlying temporal auditory processing deficit. Using the sustained frequency following response (FFR) and the onset auditory brainstem responses (ABR) we evaluated if children with SLI show abnormalities at the brainstem level consistent with a temporal processing deficit. To this end, the neural encoding of tonal sweeps, as reflected in the FFR, for different rates of frequency change, and the effects of reducing inter-stimulus interval on the ABR components were evaluated in 10 4–11-year-old SLI children and their age-matched controls. Results for the SLI group showed degraded FFR phase-locked neural activity that failed to faithfully track the frequency change presented in the tonal sweeps, particularly at the faster sweep rates. SLI children also showed longer latencies for waves III and V of the ABR and a greater prolongation of wave III at high stimulus rates (>30/sec), suggesting greater susceptibility to neural adaptation. These results taken together appear to suggest a disruption in the temporal pattern of phase-locked neural activity necessary to encode rapid frequency change and an increased susceptibility to desynchronizing factors related to faster rates of stimulus presentation in children with SLI.     

Control of Expressive and Metronomic Timing in Pianists

In 12 tasks, each including 10 repetitions, 6 skilled pianists performed or responded to a musical excerpt. In the first 6 tasks, expressive timing was required; in the last 6 tasks, metronomic timing. The pianists first played the music on a digital piano (Tasks 1 and 7), then played it without auditory feedback (Tasks 2 and 8), then tapped on a response key in synchrony with one of their own performances (Tasks 3 and 9), with an imagined performance (Tasks 4 and 10), with a computer-generated performance (Tasks 5 and 11), and with a computer-generated sequence of clicks (Tasks 6 and 12). The results demonstrated that pianists are capable of generating the expressive timing pattern of their performance in the absence of auditory and kinaesthetic (piano keyboard) feedback. They can also synchronize their finger taps quite well with expressively timed music or clicks (while imagining the music), although they tend to underestimate long interonset intervals and to compensate on the following tap. Expressive timing is thus shown to be generated from an internal representation of the music. In metronomic performance, residual expressive timing effects were evident. Those did not depend on auditory feedback, but they were much reduced or absent when kinaesthetic feedback from the piano keyboard was eliminated. Thus, they seemed to arise from the pianist's physical interaction with the instrument. Systematic timing patterns related to expressive timing were also observed in synchronization with a metronomic computer performance and even in synchronization with metronomic clicks. These results shed light on intentional and unintentional, structurally governed processes of timing control in music performance.     

Spatial and temporal frequency in figure-ground organization

Figure-ground organization of an ambiguous pattern can be manipulated by the spatial and temporal frequency content of the two regions of the pattern. Controlling for space-averaged luminance and perceived contrast, we tested patterns in which the two regions of the ambiguous pattern contained sine-wave gratings of 8, 4, 1, or 0.5 cycles per degree (cpd) undergoing on:off flicker at the rates of 0, 3.75, 7.5, or 15 Hz. For a full set of combinations of temporal frequency differences, with each spatial frequency the higher temporal frequency was seen as background for more of the viewing time. For two spatial frequency combinations, 1 and 4 cpd, and 1 and 8 cpd, tested under each of the four temporal frequencies, the lower spatial frequency region was seen as the background for more of the viewing time. When the effects of spatial and temporal frequency were set in opposition, neither was predominant in determining perceptual organization. It is suggested that figure-ground organization may parallel the sustained-transient response characteristics of the visual system.     

人类颞叶皮层与视、听信息加工:Ⅰ、神经心理模型和左颞叶癫痫病人的认知功能

对37名被试的18项神经心理测验结果进行因素分析后得到4个主要因素:知觉组织、感觉注意、记忆和知觉运动。对比组t 考验发现左颞叶瘢痫病人的节律跟随和说话人识别测验得分明显低于普通外科病人,说明左颞叶癫痫病可能影响听觉运动和非言语复杂听觉信息加工的能力。     

Perceptual learning in auditory temporal discrimination: No evidence for a cross-modal transfer to the visual modality

Perceptual learning was used to study potential transfer effects in a duration discrimination task. Subjects were trained to discriminate between two empty temporal intervals marked with auditory beeps, using a twoalternative forced choice paradigm. The major goal was to examine whether perceptual learning would generalize to empty intervals that have the same duration but are marked by visual flashes. The experiment also included longer intervals marked with auditory beeps and filled auditory intervals of the same duration as the trained interval, in order to examine whether perceptual learning would generalize to these conditions within the same sensory modality. In contrast to previous findings showing a transfer from the haptic to the auditory modality, the present results do not indicate a transfer from the auditory to the visual modality; but they do show transfers within the auditory modality.     

Electrophysiological evidence for age effects on sensory memory processing of tonal patterns

In older adults, difficulties processing complex auditory scenes, such as speech comprehension in noisy environments, might be due to a specific impairment of temporal processing at early, automatic processing stages involving auditory sensory memory (ASM). Even though age effects on auditory temporal processing have been well-documented, there is a paucity of research on how ASM processing of more complex tone-patterns is altered by age. In the current study, age effects on ASM processing of temporal and frequency aspects of two-tone patterns were investigated using a passive listening protocol. The P1 component, the mismatch negativity (MMN) and the P3a component of event-related brain potentials (ERPs) to tone frequency and temporal pattern deviants were recorded in younger and older adults as a measure of auditory event detection, ASM processing, and attention switching, respectively. MMN was elicited with smaller amplitude to both frequency and temporal deviants in older adults. Furthermore, P3a was elicited only in the younger adults. In conclusion, the smaller MMN amplitude indicates that automatic processing of both frequency and temporal aspects of two-tone patterns is impaired in older adults. The failure to initiate an attention switch, suggested by the absence of P3a, indicates that impaired ASM processing of patterns may lead to less distractibility in older adults. Our results suggest age-related changes in ASM processing of patterns that cannot be explained by an inhibitory deficit.     

No evidence for qualitative differences in the processing of short and long temporal intervals

Several lines of research suggest that two distinct timing mechanisms are involved in temporal information processing: a sensory mechanism for processing of durations in the range of milliseconds and a cognitively controlled mechanism for processing of longer durations. The present study employed a dual-task approach and a sensory interference paradigm to further elucidate the distinct timing hypothesis. Experiment 1 used mental arithmetic as a nontemporal secondary task, Experiment 2 a memory search task, and Experiment 3 a visuospatial memory task. In Experiment 4, a loudness manipulation was applied. Mental arithmetic and loudness manipulation affected temporal discrimination of both brief and long intervals, whereas the two remaining tasks did not influence timing performance. Observed differences in interference patterns may be explained by some tasks being more difficult than others. The overall pattern of results argues against two qualitatively distinct timing mechanisms, but is consistent with attention-based cognitive models of human timing.     

Perceptual organization of auditory temporal patterns in European starlings (Sturnus vulgaris)

The perception of continuously repeating auditory patterns by European starlings was explored in seven experiments. In Experiment 1, 4 starlings learned to discriminate between two continuously repeating, eight-element, auditory patterns. Each eight-element pattern was constructed from different temporal organizations of two elements differing in timbre. In Experiments 2–7, the repeating patterns were transformed in ways designed to identify the starlings’ perceptual organization of the patterns. In Experiment 2, the starlings identified patterns beginning with novel starting points. In Experiment 3, discrimination performance was adversely affected by reorganizing the elements in the patterns. In Experiments 4 and 5, the pattern elements were altered. In Experiment 4, the patterns were constructed from two novel elements. In Experiment 5, the temporal location of the two pattern elements was reversed. The transformations of the patterns in Experiments 4 and 5 affected discrimination performance for some, but not all, of the starlings. In Experiments 6 and 7, replacing either of the two elements with silent intervals had no effect on discrimination performance. The results of these experiments identify basic grouping principles that starlings use when they perceive auditory patterns.     

Spatial stimulus cue information supplying auditory saltation

Auditory saltation is a misperception of the spatial location of repetitive, transient stimuli. It arises when clicks at one location are followed in perfect temporal cadence by identical clicks at a second location. This report describes two psychophysical experiments designed to examine the sensitivity of auditory saltation to different stimulus cues for auditory spatial perception. Experiment 1 was a dichotic study in which six different six-click train stimuli were used to generate the saltation effect. Clicks lateralised by using interaural time differences and clicks lateralised by using interaural level differences produced equivalent saltation effects, confirming an earlier finding. Switching the stimulus cue from an interaural time difference to an interaural level difference (or the reverse) in mid train was inconsequential to the saltation illusion. Experiment 2 was a free-field study in which subjects rated the illusory motion generated by clicks emitted from two sound sources symmetrically disposed around the interaural axis, ie on the same cone of confusion in the auditory hemifield opposite one ear. Stimuli in such positions produce spatial location judgments that are based more heavily on monaural spectral information than on binaural computations. The free-field stimuli produced robust saltation. The data from both experiments are consistent with the view that auditory saltation can emerge from spatial processing, irrespective of the stimulus cue information used to determine click laterality or location.