Perceptual integration of timing and intensity variations in the perception of musical accents

The author investigated the detection of timing and intensity variations in tone sequences within the framework of perceptual independence or integration. The participants listened to sequences of tones that contained variations in timing, intensity, or both. Each participant tried to detect variations in the dimension that was declared relevant, which was either timing or intensity. The irrelevant dimension was held constant, or varied in a manner uncorrelated with the relevant dimension, or varied in a correlated manner. When the variations in the 2 dimensions were correlated, the correlation could be either positive (i.e., timing and intensity created accents in the same sequences) or negative (i.e., timing and intensity created accents in different sequences). Uncorrelated variation in the irrelevant dimension interfered with the detection of variations in the relevant dimension. In the case of a positive correlation between the 2 dimensions, the detection of variations was better than it was with the absence of variation in the irrelevant dimension only for participants who attended to timing. In the case of a negative correlation, the effect was the opposite. The results showed that timing and intensity accents were not processed by completely independent channels. Rather, information from the 2 dimensions combined at a late stage of processing.     

Perceptual Integration of Timing and Intensity Variations in the Perception of Musical Accents

The author investigated the detection of timing and intensity variations in tone sequences within the framework of perceptual independence or integration. The participants listened to sequences of tones that contained variations in timing, intensity, or both. Each participant tried to detect variations in the dimension that was declared relevant, which was either timing or intensity. The irrelevant dimension was held constant, or varied in a manner uncorrelated with the relevant dimension, or varied in a correlated manner. When the variations in the 2 dimensions were correlated, the correlation could be either positive (i.e., timing and intensity created accents in the same sequences) or negative (i.e., timing and intensity created accents in different sequences). Uncorrelated variation in the irrelevant dimension interfered with the detection of variations in the relevant dimension. In the case of a positive correlation between the 2 dimensions, the detection of variations was better than it was with the absence of variation in the irrelevant dimension only for participants who attended to timing. In the case of a negative correlation, the effect was the opposite. The results showed that timing and intensity accents were not processed by completely independent channels. Rather, information from the 2 dimensions combined at a late stage of processing.     

Temporal summation and phenomenal simultaneity: Experiments with the radius display

This study explores the phenomenon of subjective simultaneity between multiple successive positions of a target, which consisted here of an illuminated radial line in both stepwise and continous rotation around a fixation point. In four experiments the span of phenomenal simultaneity (M) was measured under varying intensities of target and surround, and with two different estimation procedures. M was found to change as a power function of target intensity, with an exponent of -0.13 or -0.16, for both stroboscopic and continuous illumination of the target. Variation of surround intensity affected M only for 9 out of 15 subjects (Experiment III.) For these subjects M varied inversely with log I of the surround; for the remaining 6 subjects M remained approximately constant over a range of 5 log units of I. Auditory noise tended slightly to decrease M in the former group and to increase it in the latter. Under simultaneous continuous and stroboscopic illumination of the target a paradoxical, single-valued M was obtained (Experiment IV). Higher values of M were found when subjects attempted to estimate the number of apparently simultaneous radii (Experiment I). The function relating M to target intensity closely parallels that for the critical duration of temporal brightness summation. The possibility that both measures reflect the same underlying process is discussed.     

High-intensity sound increases the size of visually perceived objects

The effect of audiovisual interactions on size perception has yet to be examined, despite its fundamental importance in daily life. Previous studies have reported that object length can be estimated solely on the basis of the sounds produced when an object is dropped. Moreover, it has been shown that people typically and easily perceive the correspondence between object sizes and sound intensities. It is therefore possible that auditory stimuli may act as cues for object size, thereby altering the visual perception of size. Thus, in the present study we examined the effects of auditory stimuli on the visual perception of size. Specifically, we investigated the effects of the sound intensity of auditory stimuli, the temporal window of audiovisual interactions, and the effects of the retinal eccentricity of visual stimuli. The results indicated that high-intensity auditory stimuli increased visually perceived object size, and that this effect was especially strong in the peripheral visual field. Additional consideration indicated that this effect on the visual perception of size is induced when the cue reliability is relatively higher for the auditory than for the visual stimuli. In addition, we further suggest that the cue reliabilities of visual and auditory stimuli relate to retinal eccentricity and sound intensity, respectively.     

Variation of the magnitude of the horizontal-vertical illusion with retinal eccentricity

The horizontal-vertical illusion was studied as a function of retinal eccentricity. It was found that the relation of illusion magnitude to vertical eccentricity is described by a U-shaped function with large amounts of reversed illusion for the more eccentric positions. Substantial effects due to horizontal eccentricity were also obtained, but these were not consistent across subjects. It is suggested that the flattening of the peripheral zones of the refracting surfaces of the eye may be involved in the variation of the illusion with retinal position, and that the astigmatic properties of the central portions of these surfaces may be a prime factor in the usual horizontal-vertical illusion.     

Sensorimotor Impairment of Speech and Hand Movement Timing Processing in Parkinson’s Disease

Models of motor control have highlighted the role of temporal predictive mechanisms in sensorimotor processing of speech and limb movement timing. We investigated how these mechanisms are affected in Parkinson’s disease (PD) while patients performed speech and hand motor reaction time tasks in response to sensory stimuli with predictable and unpredictable temporal dynamics. Results showed slower motor reaction times in PD vs. control in response to temporally predictable, but not unpredictable stimuli. This effect was driven by faster motor responses to predictable stimuli in control subjects; however, no such effect was observed in the PD group. These findings indicated the relationship between PD pathology and sensorimotor deficits in temporal predictive mechanisms of timing processing during speech production and hand movement.     

Effects of variation in the warning signal on reaction times of severe subnormals

Reaction times of normal and subnormal subjects were compared, when a warning stimulus varied in modality as well as in its temporal relation to the RT signal. When the warning stimulus was in a different modality from the RT signal, reaction times were shorter than when both were in the same modality. Mongols, in contrast to the other subjects, responded relatively faster to light than to sound.

The effect of varying the time interval between warning and signal was linearly related to response speed. The results are discussed in respect to the comparative alerting effects of temporal relations between stimuli and their different modalities.     

Detection performance in pop-out tasks: nonmonotonic changes with display size and eccentricity

We carried out three experiments to investigate detection performance in pop-out tasks and analysed how performance varied as a function of display size (number of elements) and retinal eccentricity of the target. Results showed that when display size was increased from 2 to 81 elements performance first decreased and then increased (replicating Sagi and Julesz, 1987 Spatial Vision 2 39-49). Performance variations differed as a function of eccentricity and often were more pronounced in the periphery than in the foveal area. This retinal-eccentricity influence suggests that processes underlying detection performance in small display sizes are different from those in large display sizes. One should be careful when using the variation of display size as an instrument to analyse visual-search processes because this analysis could be based on a comparison between non-equivalent conditions.     

Figurai vs. configural effects in the filled duration illusion

Patterns varying in form goodness and size were presented for 15, 30, and 45 msec. The experiment included three independent groups of subjects. Half of the first group were presented size variations with good figures, while the other half were shown size variations with poor figures. Half of the second group were presented goodness variations with small figures, while the other half were shown goodness variations with large figures. A third group experienced variations in both goodness and size. The major findings were: (1) poor figures and large figures were judged “longer” than good or small figures when varied within a session; (2) this effect vanished when the different levels of size or goodness were presented to separate groups of subjects; (3) the magnitude of the difference in temporal estimation was the same for size and goodness when each was varied in isolation; (4) when size and form goodness were varied orthogonally in the same session, both dimensions produced reliable changes in temporal estimation. These data are discussed in light of current theoretical explanations of the filled duration illusion.     

Children do not recalibrate motor‐sensory temporal order after exposure to delayed sensory feedback

Prolonged adaptation to delayed sensory feedback to a simple motor act (such as pressing a key) causes recalibration of sensory‐motor synchronization, so instantaneous feedback appears to precede the motor act that caused it (Stetson, Cui, Montague & Eagleman, 2006). We investigated whether similar recalibration occurs in school‐age children. Although plasticity may be expected to be even greater in children than in adults, we found no evidence of recalibration in children aged 8–11 years. Subjects adapted to delayed feedback for 100 trials, intermittently pressing a key that caused a tone to sound after a 200 ms delay. During the test phase, subjects responded to a visual cue by pressing a key, which triggered a tone to be played at variable intervals before or after the keypress. Subjects judged whether the tone preceded or followed the keypress, yielding psychometric functions estimating the delay when they perceived the tone to be synchronous with the action. The psychometric functions also gave an estimate of the precision of the temporal order judgment. In agreement with previous studies, adaptation caused a shift in perceived synchrony in adults, so the keypress appeared to trail behind the auditory feedback, implying sensory‐motor recalibration. However, school children of 8 to 11 years showed no measureable adaptation of perceived simultaneity, even after adaptation with 500 ms lags. Importantly, precision in the simultaneity task also improved with age, and this developmental trend correlated strongly with the magnitude of recalibration. This suggests that lack of recalibration of sensory‐motor simultaneity after adaptation in school‐age children is related to their poor precision in temporal order judgments. To test this idea we measured recalibration in adult subjects with auditory noise added to the stimuli (which hampered temporal precision). Under these conditions, recalibration was greatly reduced, with the magnitude of recalibration strongly correlating with temporal precision.     

Informational and neural adaptation curves are asynchronous.

Norwich's entropy theory of perception (plus a few additional assumptions) suggests the existence of an "infromational adaptation curves" (change in stimulus equivocation with stimulus duration) for suprathreshold prothetic stimuli that is synchronous with the "neural adaptation curve" (change in firing rate with stimulus duration) observed for sensory neurons. Five experiments are reported in which informational adaptation curves were measured for auditory and visual stimuli by having subjects make absolute identifications of suprathreshold sound or light intenstiies of various durations. Information transmissions for the shortest duration stimuli (1 and 5 msec, respectively, for light and sound) were surprisingly large (small equivocations), indicating that intensity information is acquired very rapidly by the whole organism. The equations of entropy theory were fitted to adaptation data for peripheral sensory neurons (spiral ganglion cells and retinal ganglion cells) and were compared to the informational adaptation curves. It was found that informational adaptation occurred more rapidly than neural adaptation. That is, the two types of adaptation process are asynchronous. However, for both audition and vision, the total amount of information mediated by the adaptation process (channel capacity) was about the same for both types of processes (2.03 bits vs. 2.1 bits per stimulus for sound intensity; 1.3 vs. 2.0 bits per stimulus for light intensity). Faster acquisition could be accomplished in the whole organism through convergent neural circuits that increase sampling rate by pooling the samples taken by individual receptor systems.     

Informational and neural adaptation curves are asynchronous

Norwich’s entropy theory of perception (plus a few additional assumptions) suggests the existence of an “informational adaptation curve” (change in stimulus equivocation with stimulus duration) for suprathreshold prothetic stimuli that is synchronous with the “neural adaptation curve” (change in firing rate with stimulus duration) observed for sensory neurons. Five experiments are reported in which informational adaptation curves were measured for auditory and visual stimuli by having subjects make absolute identifications of suprathreshold sound or light intensities of various durations. Information transmissions for the shortest duration stimuli (1 and 5 msec, respectively, for light and sound) were surprisingly large (small equivocations), indicating that intensity information is acquired very rapidly by the whole organism. The equations of entropy theory were fitted to adaptation data for peripheral sensory neurons (spiral ganglion cells and retinal ganglion cells) and were compared to the informational adaptation curves. It was found that informational adaptation occurred more rapidly than neural adaptation. That is, the two types of adaptation process are asynchronous. However, for both audition and vision, the total amount of information mediated by the adaptation process (channel capacity) was-about the same for both types of processes (2.03 bits vs. 2.1 bits per stimulus for sound intensity; 1.3 vs. 2.0 bits per stimulus for light intensity). Faster acquisition could be accomplished in the whole organism through convergent neural circuits that increase sampling, rate-by pooling the samples taken by individual receptor systems     

Aspects of temporal information processing: A dimensional analysis

A major controversy in the field of prospective temporal information processing refers to the question of whether performance in various temporal tasks can be accounted for by the general assumption of an internal clock rather than by distinct, task-specific timing mechanisms. Therefore, the present study was designed to identify dimensions of temporal information processing. For this purpose, 120 subjects performed eight psychophysical temporal tasks. Correlational and principal factor analyses suggested a common pacemaker-based interval timing mechanism involved in duration discrimination, temporal generalization, and temporal order judgment. On the other hand, rhythm perception and perceived simultaneity/successiveness appeared to be controlled by task-specific processes unrelated to interval-based timing.     

Humor response as related to violation of expectancies and to stimulus intensity in a weight-judgment task.

In a study of humor disguised as a psychophysical task, 60 subjects judged an initial series of 10 weights which was either light or heavy and then a shift weight which was either light, medium, or heavy. Degree of humorous response varied with the discrepancy of the shift weight and its absolute magnitude.     

The start-stop procedure: Estimation

In four experiments investigating human timing, subjects produced estimates of sample durations by bracketing their endpoints. On each trial, subjects reproduced a sample duration by pressing a button before the estimated sample duration elapsed (start time) and releasing it after the estimated duration elapsed (stop time). From these responses, middle time (start + stop/2) and spread time (stop — start) were calculated, representing the point of subjective equality and the difference limen, respectively. In all experiments, subjects produced middle times that varied directly with sample duration. In Experiment 2, middle times lengthened when feedback was withheld. Consistent with Weber timing, spread times, as well as the standard deviation of middle times, varied directly with middle time (Experiments 1, 3, and 4). On the basis of an internal clock model of timing (Gibbon & Church, 1990), the data permitted inferences regarding memory processes and response threshold. Correlations between start and stop times and between start and spread times agreed with earlier findings in animals suggesting that the variance of temporal estimates across trials is based in part upon the selection of a single temporal memory sample from a reference memory store and upon one or two threshold samples for initiating and terminating each estimate within a trial.     

Response latency and accuracy in visual word recogniton

In a single visual word recognition experiment, the effects of (1) eccentricity of presentation, (2) word length, and (3) word frequency were investigated. The stimuli used were Dutch nouns in two frequency classes of about 15 and 150.10^-6; word length varied from 1 to 10; eccentricity varied from ?4 to +4 deg. The response quality and response latency of 11 subjects were measured. For the correct responses, recognition scores decreased and response latencies increased with eccentricity; both showed asymmetrical curves in the visual field. It is argued that word length proper affects neither the probability of correct responses nor latency. A clear word frequency effect was established. The eccentricity of presentation is considered as the determinant of the amount of available information, thus directly influencing accuracy and latency. The linear relationship between accuracy and latency is a major finding. A word recognition scheme is offered which incorporates (1) activation, (2) decision, and (3) speech. The time relations between incoming retinal information and response decision, leading to an extra 400 msec for incorrect as compared with correct responses, are discussed. Word recognition in reading is examined, together with the impact of the present experimental results on information flow in successive eye fixations, eye movement control, and eye-voice span.     

Hemisphere differences and judgments of simultaneity of brief light flashes

A series of experiments was conducted to investigate the possibility of hemispheric specialization for judgments of the simultaneity of two light flashes. Right-handed subjects adjusted two light flashes until they appeared simultaneous. The comparison of measures derived from the two possible orders of the light flashes suggested that the right hemisphere of right-handed subjects performed the function of ordering visual stimuli in time. Two further experiments examined an alternative explanation, that of a left-to-right scanning mechanism, the results of which also suggested a hemisphere explanation. The results of these experiments are discussed in terms of previous research and theories which located a temporal ordering mechanism in the speech hemisphere.     

A "change-of-standard" perspective on the relations among context, judgment, and memory

We conducted three studies that tested a "change-of-standard" perspective on the relations among context, judgment, and recall. Each study consisted of two or three sessions held a few days apart. All subjects read about the sentencing decisions of one or two target trial judges and of six nontarget trial judges who consistently gave either higher or lower sentences than the target judge(s). Each study varied both the standard that was available when subjects initially judged the sentencing decisions of a target judge and the standard available when subjects subsequently recalled those decisions. To accomplish this, we varied the context of judgment, the timing of judgment, and the overall category norm for trial judges' sentencing decisions that was available at recall. We found that although subjects had been exposed to the same target information and had initially judged it in the same way, their recall of the information was different depending on whether and how a change-of-standard had occurred between judgment and recall. Unique predictions of the change-of-standard perspective were confirmed that could not be accounted for in terms of other types of context effects on judgment and memory.     

Directed attention and perception of temporal order.

The present research examined the effects of directed attention on speed of information transmission in the visual system. Ss judged the temporal order of 2 stimuli while directing attention toward 1 of the stimuli or away from both stimuli. Perception of temporal order was influenced by directed attention: Given equal onset times, the attended stimulus appeared to occur before the unattended stimulus. Direction of attention also influenced the perception of simultaneity. The findings support the notion that attention affects the speed of transmission of information in the visual system. To account for the pattern of temporal order and simultaneity judgments, a model is proposed in which the temporal profile of visual responses is affected by directed attention.     

Limits of rhythm perception

To what extent are listeners sensitive to the time intervals separating non-consecutive events in sound sequences? The subjects of Experiment 1 were presented with sequences of 20 identical tones in which the 10 odd-numbered tones or the 10 even-numbered tones made up an isochronous sub-sequence (with a periodicity of 0.5-1 s) whereas the other tones, acting as distractors, occurred at random moments. Such sequences appeared to be very difficult to discriminate from sequences without any timing regularity, which revealed a lack of perceptual sensitivity to their "second-order" intervals. Experiment 2 employed repetitive sequences in which the first-order intervals (separating consecutive tones) took two possible values, forming a ratio that subjects had to classify as larger or smaller than 2. The results of this experiment suggest that subjects were able to make use of second-order intervals in their task, but mainly due to the predictable nature of the sequences; the relative positions of subjective accents (Povel & Essens, 1985) had no significant effect on performance. It is concluded that the perception of subtle timing details in "ordinary" music may rest on nothing more than a sensitivity to the relations between first-order intervals (within a given auditory stream).