Binding time: Evidence for integration of temporal stimulus features

Several lines of evidence suggest that during processing of events, the features of these events become connected via episodic bindings. Such bindings have been demonstrated for a large number of visual and auditory stimulus features, like color and orientation, or pitch and loudness. Importantly, most visual and auditory events typically also involve temporal features, like onset time or duration. So far, however, whether temporal stimulus features are also bound into event representations has never been tested directly. The aim of the present study was to investigate possible binding between stimulus duration and other features of auditory events. In Experiment 1, participants had to respond with two keys to a low or high pitch sinus tone. Critically, the tones were presented with two different presentation durations. Sequential analysis of RT data indicated binding of stimulus duration into the event representation: at pitch repetitions, performance was better when both pitch and duration repeated, relative to when only pitch repeated and duration switched. This finding was replicated with loudness as relevant stimulus feature in Experiment 2. In sum, the results demonstrate that temporal features are bound into auditory event representations. This finding is an important advancement for binding theory in general, and raises several new questions for future research.     

The perceptual basis of loudness ratio judgments

In Experiment 1, subjects were required to estimateloudness ratios for 45 pairs of tones. Ten 1,200-Hz tones, differing only in intensity, were used to generate the 45 distinct tone pairs. In Experiment 2, subjects were required to directly compare two pairs of tones (chosen from among the set of 45) and indicate which pair of tones had the greaterloudness ratio. In both Experiments 1 and 2, the subjects’ judgments were used to rank order the tone pairs with respect to their judged loudness ratios. Nonmetric analyses of these rank orders indicated that both magnitude estimates of loudness ratios and direct comparisons of loudness ratios were based on loudnessintervals ordifferences where loudness was a power function of sound pressure. These experiments, along with those on loudness difference judgments (Parker & Schneider, 1974; Schneider, Parker, & Stein, 1974), support Torgerson’s (1961) conjecture that there is but one comparative perceptual relationship for ioudnesses, and that differences in numerical estimates for loudness ratios as opposed to loudness intervals simply reflect different reporting strategies generated by the two sets of instructions.     

Binaural and temporal integration of the loudness of tones and noises

Subjects judged the loudness of tones (Experiment 1) and of bursts of noise (Experiment 2) that varied in intensity and duration as well as in mode of presentation (monaural vs. binaural). Both monaural and binaural loudness, for both types of signals, obeyed the bilinear-interaction prediction of the classic temporal integration model. The loudness of short tones grows as a power function of both intensity and duration with different exponents for the two factors (.2 and .3, respectively). The loudness of wide-band noises grows as a power function of duration (with an exponent of approximately .6) but not of sound pressure. For tones, binaural summation was constant but fell short of full additivity. For noises, summation changed across level and duration. Temporal summation followed the same course for monaural and binaural tonal stimuli but not for noise stimuli. Notwithstanding these differences between tone and noise, we concluded that binaural and temporal summation are independently operating integrative networks within the auditory system. The usefulness of establishing the underlying metric structure for temporal summation is emphasized.     

Accuracy and Confidence of Duration Estimates Following Questions Containing Marked and Unmarked Modifiers1

Eighty-five subjects were engaged in a two-person discussion for 20 minutes or for 40 minutes. Half of each group was tested immediately and the remainder one week later for their estimate of the duration of the discussion. Postevent questions were phrased with either a marked modifier (“How short was our discussion?”) or an unmarked modifier (“How long was our discussion?”), or subjects were tested using a non-leading noun-form statement (“What was the duration of our discussion?”). Sixty-seven percent of all subjects underestimated and 31% overestimated their respective durations. Accuracy of time estimation was unrelated to the length of the discussion or to the time of test. The adverb short on average produced overestimations, whereas the adverb long and the noun duration on average produced underestimations. No relationship was found between accuracy of estimation and certainty of estimation.     

The slippery context effect in psychophysics: Intensive,extensive, and qualitative continua

When subjects gave magnitude estimates of 500- and 2500-Hz tones at various SPLs, they judged a 500-Hz tone of 60 dB to be as loud as a 2500-Hz tone of 57 dB in one context (low SPLs at 500 Hz, high SPLs at 2500 Hz), but as loud as a 2500-Hz tone at 40 dB in another context (high SPLs at 500 Hz, low at 2500 Hz) (Marks, 1988). Such shifts in matches derived from judgments of multi-dimensionally varying stimuli are termedslippery context effects. The present set of seven experiments showed that slippery effects were absent from judgments of pitch of tones at different loudnesses, duration of tones at different pitches, and length of lines at different colors, though a small effect emerged in judgments of duration of tones and lights. Slippery context effects were substantial when subjects gave magnitude estimates of loudness of 500- and 2500-Hz tones under conditions in which the pitch at each trial either was cued visually beforehand or could be known through the regular stimulus sequence, and with instructions to make absolute magnitude estimates. The results are consistent with the view that slippery context effects occur automatically and “preattentively.”     

Syllabic tone articulation influences the identification and use of words during Chinese sentence reading: Evidence from ERP and eye movement recordings

In two experiments, we examined the contribution of articulation-specific features to visual word recognition during the reading of Chinese. In spoken Standard Chinese, a syllable with a full tone can be tone-neutralized through sound weakening and pitch contour change, and there are two types of two-character compound words with respect to their articulation variation. One type requires articulation of a full tone for each constituent character, and the other requires a full- and a neutral-tone articulation for the first and second characters, respectively. Words of these two types with identical first characters were selected and embedded in sentences. Native speakers of Standard Chinese were recruited to read the sentences. In Experiment 1, the individual words of a sentence were presented serially at a fixed pace while event-related potentials were recorded. This resulted in less-negative N100 and anterior N250 amplitudes and in more-negative N400 amplitudes when targets contained a neutral tone. Complete sentences were visible in Experiment 2, and eye movements were recorded while participants read. Analyses of oculomotor activity revealed shorter viewing durations and fewer refixations on—and fewer regressive saccades to—target words when their second syllable was articulated with a neutral rather than a full tone. Together, the results indicate that readers represent articulation-specific word properties, that these representations are routinely activated early during the silent reading of Chinese sentences, and that the representations are also used during later stages of word processing.     

Avoidance responding as a function of stimulus duration and relation to free shock

Response-independent pairings of a tone and a brief shock were superimposed on uncued avoidance responding in four groups of rhesus monkeys. For one group, tone presentations were immediately followed by an unavoidable electric shock; for the remaining groups, gaps of 5, 20, and 80 sec intervened between tone termination and shock delivery. These temporal values subsume paradigms usually treated as discrete procedures; the conditioned emotional response procedure (0-sec gap between tone and shock), trace procedure (5-sec gap) and safety-signal training (80-sec gap). Within each group, tone durations of 10, 20, 40, and 80 sec were examined. A response pattern marked by maximum response rate in the initial 5 sec of the tone followed by deceleration before shock was observed when shock immediately followed the tone, but not when gaps were interposed between the tone and shock. Response rates in the first 5 sec of the tone were a function of both tone duration and duration of the gap. When the gap was 0 to 5 sec, initial response rates were highest in longer duration tones; this relationship between tone duration and initial tone response rate was not observed for longer gaps.     

Aptitude-related differences in auditory information processing: effects of selective attention and tone duration

College students selected for high or low aptitude performed an auditory backward recognition masking task in which tones differed in pitch (770 or 870 Hz) and duration (10, 13 or 20 msec). Ss were required to attend selectively to the pitch but not to the duration of the targets. As predicted, higher aptitude was associated with lower recognition thresholds at all tone durations. Although increased attentional demands impaired recognition thresholds, this had no apparent differential effect on aptitude-related differences in auditory information processing.     

The measurement of loudness using direct comparisons of sensory intervals

Subjects were required in each trial to directly compare two pairs of tones and indicate which pair of tones had the greater loudness difference. Ten 1200 Hz tones differing only in intensity were employed. Subjects made binary comparisons among the 45 tone pairs which can be formed from the set of ten tones. The subjects' binary comparisons of the tone pairs were found to satisfy the transitivity and monotonicity requirements of a positive difference structure. These comparisons of loudness intervals were used to construct a rank order of loudness difference. A loudness scale was constructed from a nonmetric analysis of the rank order of loudness difference for the 45 tone pairs and indicated that loudness was a power function of sound pressure with an exponent of 0.26.     

Estimating averages from distributions of tone durations

We examined whether estimating average duration was influenced by the distribution peak location. We presented participants with samples of various tone durations and then presented comparison tone durations. Participants judged whether each comparison duration was longer than the average sample duration. Estimates of the averages were inferred from the psychophysical functions. The durations were sampled from three distributions: one positively skewed, one symmetric, and one negatively skewed. In Experiment 1, every participant was presented with every distribution. Estimates of the averages were unbiased for the symmetric distribution but were biased toward the long tail of each skewed distribution. This would occur if participants combined the sample to be judged with the previous, irrelevant samples, or with the comparison durations. In Experiment 2, each participant was presented with samples from only one of the distributions. Estimates of the averages were still biased toward the long tails of the skewed distributions. This would occur if participants combined the sample to be judged with the comparison durations, which were the same for the three distributions. In Experiment 3, each participant was presented with only one distribution, and each distribution was tested with its own comparison durations, selected as percentiles from the distribution. The estimates were accurate for the smallest population mean (positively skewed distribution) but underestimated the larger means. These results could be explained by subjective shortening of the durations in memory, with a simple equation from scalar timing theory. This equation correctly predicted two results: The estimated averages were a linear function of the stimulus means, and the variances were a linear function of the squared stimulus means. Neither prediction was dependent on the skewness of the stimulus durations.     

Effects of aging on absolute identification of duration

Experiments to examine the effects of aging on the ability to identify temporal durations in an absolute identification task are reported. In Experiment 1, older adults were worse than younger adults in identifying a tone's position within a series of 6 tones of varied durations. In Experiment 2, participants were required to identify a tone's position in 9 tones of varied durations. Older adults' performance was again worse than that of younger adults; moreover, they showed a qualitatively different pattern of errors than younger adults. In Experiment 3, in which the tones varied in pitch, the performance of older adults was worse than that of younger adults, but the error patterns of the 2 groups were similar. The results suggest that older adults have distorted memory representations for durations but not for pitch.     

Action,prediction, and temporal awareness

The brain needs to track changes in the relation between action and effect. In two experiments, participants made voluntary keypress actions. In an adaptation phase, these actions were followed after a fixed interval by a tone. During a subsequent test phase, the duration of the interval was unexpectedly changed. We used time perception as an implicit marker of the experience of participants' control over the effect, and confirmed a temporal binding between actions and effects. On test trials, participants perceived tones to occur as shifted towards their time of occurrence in the preceding adaptation phase. Therefore, the perceived time of a tone was partly based on learning of an internal prediction, rather than on the time of actual sensory input. This predictive model is rapidly updated over a few trials (Experiment 1), and requires attention to the tones (Experiment 2). The brain learns action–effect relations. This predictive learning influences the perception of effects, and underlies some temporal illusions associated with action.     

Memory for sequences of tone bursts in the rat: Reliance on temporal cues and evidence for an instructional ambiguity explanation of the choose-few effect

Two groups of rats were trained in a symbolic delayed matching-to-sample task with a 0-s delay to discriminate sample stimuli that consisted of sequences of tone bursts. For one group, sequences varied in number with total sequence duration controlled. For the other group, total sequence duration, sum of the tone durations, and sum of the gap durations were all controlled. The former group of rats acquired the discrimination, but the latter group of rats were not able to learn the discrimination with the additional temporal cues controlled. Retention functions for the group that acquired the discrimination exhibited a choose-many bias at the 1-s delay and a choose-few bias at the 8-s delay regardless of the similarity in the intertrial interval and delay interval illumination condition. The asymmetrical retention functions appeared to be due to instructional ambiguity which resulted from the similarity of the delay interval to temporal features of the tone burst sequence, such as the gap between tone bursts and the total duration of tone. In Experiment 2, diagnostic tests provided evidence that rats discriminated the sequences of tone bursts by timing and summing the duration of individual tone bursts rather than using an event switch to count tones. Like pigeons, rats use multiple temporal features rather than number to discriminate sequences of successive events.     

Distractor clustering enhances detection speed and accuracy during selective listening

The effects of distractor clustering on target detection were examined in two experiments in which subjects attended to binaural tone bursts of one frequency while ignoring distracting tones of two competing frequencies. The subjects pressed a button in response to occasional target tones of longer duration (Experiment 1) or increased loudness (Experiment 2). In evenly spaced conditions, attended and distractor frequencies differed by 6 and 12 semitones, respectively (e.g., 2096-Hz targets vs. 1482- and 1048-Hz distractors). In clustered conditions, distractor frequencies were grouped; attended tones differed from the distractors by 6 and 7 semitones, respectively (e.g., 2096-Hz targets vs. 1482- and 1400-Hz distractors). The tones were presented in randomized sequences at fixed or random stimulus onset asynchronies (SOAs). In both experiments, clustering of the unattended frequencies improved the detectability of targets and speeded target reaction times, Similar effects were found at fixed and variable SO As. Results from the analysis of stimulus sequence suggest that clustering improved performance primarily by reducing the interference caused by distractors that immediately preceded the target.     

The perception of pure and mistuned musical fifths and major thirds: Thresholds for discrimination,beats, and identification

In Experiment 1, the discriminability of pure and mistuned musical intervals consisting of simultaneously presented complex tones was investigated. Because of the interference of nearby harmonics, two features of beats were varied independently: (1) beat frequency, and (2) the depth of the level variation. Discrimination thresholds (DTs) were expressed as differences in level (AL) between the two tones. DTs were determined for musical fifths and major thirds, at tone durations of 250, 500, and 1,000 msec, and for beat frequencies within a range of .5 to 32 Hz. The results showed that DTs were higher (smaller values of ΔL) for major thirds than for fifths, were highest for the lowest beat frequencies, and decreased with increasing tone duration. Interaction of tone duration and beat frequency showed that DTs were higher for short tones than for sustained tones only when the mistuning was not too large. It was concluded that, at higher beat frequencies, DTs could be based more on the perception of interval width than on the perception of beats or roughness. Experiments 2 and 3 were designed to ascertain to what extent this was true. In Experiment 2, beat thresholds (BTs) for a large number of different beat frequencies were determined. In Experiment 3, DTs, BTs, and thresholds for the identification of the direction of mistuning (ITs) were determined. For mistuned fifths and major thirds, sensitivity to beats was about the same. ITs for fifths and major thirds were not significantly different; deviations from perfect at threshold ranged from about 20 to 30 cents. Comparison of the different thresholds revealed that DTs are mainly determined by sensitivity to beats. Detailed analysis, however, indicated that perception of interval width is a relevant aspect in discrimination, especially for the fifths.     

Decision processes in temporal discrimination

The processing dynamics underlying temporal decisions and the response times they generate have received little attention in the study of interval timing. In contrast, models of other simple forms of decision making have been extensively investigated using response times, leading to a substantial disconnect between temporal and non-temporal decision theories. An overarching decision-theoretic framework that encompasses existing, non-temporal decision models may, however, account both for interval timing itself and for time-based decision-making. We sought evidence for this framework in the temporal discrimination performance of humans tested on the temporal bisection task. In this task, participants retrospectively categorized experienced stimulus durations as short or long based on their perceived similarity to two, remembered reference durations and were rewarded only for correct categorization of these references. Our analysis of choice proportions and response times suggests that a two-stage, sequential diffusion process, parameterized to maximize earned rewards, can account for salient patterns of bisection performance. The first diffusion stage times intervals by accumulating an endogenously noisy clock signal; the second stage makes decisions about the first-stage temporal representation by accumulating first-stage evidence corrupted by endogenous noise. Reward-maximization requires that the second-stage accumulation rate and starting point be based on the state of the first-stage timer at the end of the stimulus duration, and that estimates of non-decision-related delays should decrease as a function of stimulus duration. Results are in accord with these predictions and thus support an extension of the drift–diffusion model of static decision making to the domain of interval timing and temporal decisions.     

Constraints on Pavlovian conditioning of the pigeon: Relative conditioned reinforcing effects of red-light and tone CSs paired with food

Recent Pavlovian conditioning experiments presented all possible CS-US combinations of red-light and tone CSs and food and shock USs to separate groups of pigeons. Pigeons receiving shock USs demonstrated conditioned head raising followed by prancing to both CSs, but CRs were acquired more rapidly to tone than to red light. Although pigeons receiving food USs rapidly acquired a conditioned response of pecking to the red-light CS, there was no evidence of conditioned responding in groups receiving tone-food pairings. This outcome left open the possibility that Pavlovian pairings of tone and food may have resulted in association formation that was not revealed in performance. The present series of experiments attempted to reveal that association, using an indirect method of assessment, conditioned reinforcement. Experiment 1 demonstrated that both red light and tone paired with food became positive conditioned reinforcers, suggesting that an association between tone and food was formed in the same number of Pavlovian conditioning trials that previously failed to yield any direct evidence of conditioning. Experiment 2, which presented fewer conditioning trials, revealed that the tone-food association was formed less rapidly than the red light-food association. Experiment 3 demonstrated that the observed outcomes were not attributable to unconditioned, rather than conditioned, reinforcing effects of the Css.     

On cross-modal similarity: the perceptual structure of pitch, loudness, and brightness

Examined how pitch and loudness correspond to brightness. In the Experiment 1, 16 Ss identified which of 2 lights more resembled each of 16 tones; in Experiment 2, 8 of the same 16 Ss rated the similarity of lights to lights, tones to tones, and lights to tones. (1) Pitch and loudness both contributed to cross-modal similarity, but for most Ss pitch contributed more. (2) Individuals differed as to whether pitch or loudness contributed more; these differences were consistent across matching and similarity scaling. (3) Cross-modal similarity depended largely on relative stimulus values. (4) Multidimensional scaling revealed 2 perceptual dimensions, loudness and pitch, with brightness common to both. A simple quantitative model can describe the cross-modal comparisons, compatible with the view that perceptual similarity may be characterized through a malleable spatial representation that is multimodal as well as multidimensional.     

Effects of feedback and calibration on the verbal estimation of the duration of tones

Two experiments investigated the effects of feedback (Experiment 1) and calibration (Experiment 2) on verbal estimation of the duration of tones ranging from 77 to 1183 ms in length. In Experiment 1, accurate feedback was provided after half the trials in the feedback condition, and this was contrasted with a no-feedback condition in which feedback was absent. In Experiment 2, in the calibration condition, participants estimated the duration of the second of two tones, after a first tone of a known duration (ranging from 50 to 1200 ms) had been presented. In the no calibration condition the value of the first tone was unknown. Compared with conditions without feedback or calibration, the feedback/calibration operation produced no significant change in group mean estimates, nor coefficients of variation of estimates, but the absolute deviation of estimates from the real stimulus duration, and the absolute deviation of individual estimates from the group mean, were both significantly reduced. The feedback/calibration thus made participants' mean estimates thus more accurate and more similar to one another, but the actual mechanism by which this was done was apparently a subtle process of adjustment, rather than a gross change in mean estimate or estimate variability.     

Illusory conjunctions of pitch and duration in unfamiliar tone sequences

In 3 experiments, the authors examined short-term memory for pitch and duration in unfamiliar tone sequences. Participants were presented a target sequence consisting of 2 tones (Experiment 1) or 7 tones (Experiments 2 and 3) and then a probe tone. Participants indicated whether the probe tone matched 1 of the target tones in both pitch and duration. Error rates were relatively low if the probe tone matched 1 of the target tones or if it differed from target tones in pitch, duration, or both. Error rates were remarkably high, however, if the probe tone combined the pitch of 1 target tone with the duration of a different target tone. The results suggest that illusory conjunctions of these dimensions frequently occur. A mathematical model is presented that accounts for the relative contribution of pitch errors, duration errors, and illusory conjunctions of pitch and duration.