Evidence for multiple strategies in off-beat tapping with anisochronous stimuli

There is a large body of evidence relating to the ways that people tap in time with sounds, and perform error correction in order to do this. However, off-beat tapping is less well investigated than on-beat tapping. The current study involves coordinating with a stimulus sequence with underlying isochrony and systematic deviations from this isochrony that increase or decrease in magnitude to look at people’s capacity to error-correct when performing off-beat synchronisation with a set of sounds. Participants were instructed to ‘tap between the tones’ but ‘try to maintain regularity’. While analysis using typical methods suggested a form of error correction was occurring, a series of more complex analyses demonstrated that participants’ performance during each trial can be classified according to one of four different strategies: maintaining a regular pulse, error correction, phase resetting, and negative error correction. While maintaining a regular pulse was the preferred strategy in conditions with increasingly isochronous stimuli, the majority of trials are best explained by other strategies, suggesting that participants were generally influenced by variability in the stimuli.     

Tracking simple and complex sequences

We address issues of synchronization to rhythms of musical complexity. In two experiments, synchronization to simple and more complex rhythmic sequences was investigated. Experiment 1 examined responses to phase and tempo perturbations within simple, structurally isochronous sequences, presented at different base rates. Experiment 2 investigated responses to similar perturbations embedded within more complex, metrically structured sequences; participants were explicitly instructed to synchronize at different metrical levels (i.e., tap at different rates to the same rhythmic patterns) on different trials. We found evidence that (1) the intrinsic tapping frequency adapts in response to temporal perturbations in both simple (isochronous) and complex (metrically structured) rhythms, (2) people can synchronize with unpredictable, metrically structured rhythms at different metrical levels, with qualitatively different patterns of synchronization seen at higher versus lower levels of metrical structure, and (3) synchronization at each tapping level reflects information from other metrical levels. The latter finding provides evidence for a dynamic and flexible internal representation of the sequence's metrical structure.     

Audiovisual beat induction in complex auditory rhythms: Point-light figure movement as an effective visual beat

This study investigated whether explicit beat induction in the auditory, visual, and audiovisual (bimodal) modalities aided the perception of weakly metrical auditory rhythms, and whether it reinforced attentional entrainment to the beat of these rhythms. The visual beat-inducer was a periodically bouncing point-light figure, which aimed to examine whether an observed rhythmic human movement could induce a beat that would influence auditory rhythm perception. In two tasks, participants listened to three repetitions of an auditory rhythm that were preceded and accompanied by (1) an auditory beat, (2) a bouncing point-light figure, (3) a combination of (1) and (2) synchronously, or (4) a combination of (1) and (2), with the figure moving in anti-phase to the auditory beat. Participants reproduced the auditory rhythm subsequently (Experiment 1), or detected a possible temporal change in the third repetition (Experiment 2). While an explicit beat did not improve rhythm reproduction, possibly due to the syncopated rhythms when a beat was imposed, bimodal beat induction yielded greater sensitivity to a temporal deviant in on-beat than in off-beat positions. Moreover, the beat phase of the figure movement determined where on-beat accents were perceived during bimodal induction. Results are discussed with regard to constrained beat induction in complex auditory rhythms, visual modulation of auditory beat perception, and possible mechanisms underlying the preferred visual beat consisting of rhythmic human motions.     

Unattended musical beats enhance visual processing

The present study investigated whether and how a musical rhythm entrains a listener's visual attention. To this end, participants were presented with pictures of faces and houses and indicated whether picture orientation was upright or inverted. Participants performed this task in silence or with a musical rhythm playing in the background. In the latter condition, pictures could occur off-beat or on a rhythmically implied, silent beat. Pictures presented without the musical rhythm and off-beat were responded to more slowly than pictures presented on-beat. This effect was comparable for faces and houses. Together these results indicate that musical rhythm both synchronizes and facilitates concurrent stimulus processing.     

Multiple temporal references in sensorimotor synchronization with metrical auditory sequences

A local phase perturbation in an auditory sequence during synchronized finger tapping elicits an automatic phase correction response (PCR). The stimulus for the PCR is usually considered to be the most recent tap-tone asynchrony. In this study, participants tapped on target tones ("beats") of isochronous tone sequences consisting of beats and subdivisions (1:n tapping). A phase perturbation was introduced either on a beat or on a subdivision. Both types of perturbation elicited a PCR, even though there was no asynchrony associated with a subdivision. Moreover, the PCR to a perturbed beat was smaller when an unperturbed subdivision followed than when there was no subdivision. The relative size of the PCRs to perturbed beats and subdivisions depended on tempo, on whether the subdivision was local or present throughout the sequence, and on whether or not participants engaged in mental subdivision, but not on whether or not taps were made on the subdivision level. The results show that phase correction in synchronization depends not merely on asynchronies but on perceptual monitoring of multiple temporal references within a metrical hierarchy.     

Musical groove modulates motor cortex excitability: A TMS investigation

Groove is often described as a musical quality that can induce movement in a listener. This study examines the effects of listening to groove music on corticospinal excitability. Musicians and non-musicians listened to high-groove music, low-groove music, and spectrally matched noise, while receiving single-pulse transcranial magnetic stimulation (TMS) over the primary motor cortex either on-beat or off-beat. We examined changes in the amplitude of the motor-evoked potentials (MEPs), recorded from hand and arm muscles, as an index of activity within the motor system. Musicians and non-musicians rated groove similarly. MEP results showed that high-groove music modulated corticospinal excitability, whereas no difference occurred between low-groove music and noise. More specifically, musicians’ MEPs were larger with high-groove than low-groove music, and this effect was especially pronounced for on-beat compared to off-beat pulses. These results indicate that high-groove music increasingly engages the motor system, and the temporal modulation of corticospinal excitability with the beat could stem from tight auditory–motor links in musicians. Conversely, non-musicians’ MEPs were smaller for high-groove than low-groove music, and there was no effect of on- versus off-beat pulses, potentially stemming from suppression of overt movement. In sum, high-groove music engages the motor system, and previous training modulates how listening to music with a strong groove activates the motor system.     

Perception and production of brief durations: beat-based versus interval-based timing

Two experiments examined whether timing of short intervals is beat- or interval-based. In Experiment 1, subjects heard a sequence of standard tones followed by 2 test tones; they compared the interval between test tones to the interval between the standards. If optimal precision required beat-based timing, performance should be best in blocks in which the interval between standard and test reliably matched the standard interval. No such effect was observed. In Experiment 2, subjects heard 2 test tones and reproduced the intertone interval by producing 2 keypress responses. Entrainment to the beat was apparent: First-response latency clustered around the standard interval and was positively correlated with the produced interval. However, responses occurring on or near the beat showed no better temporal fidelity than off-beat responses. One plausible interpretation of these findings is that the brain always times brief intervals with an interval timer; however, this timer can be used in a cyclic fashion to trigger rhythmic responses.     

Rate limits in sensorimotor synchronization with auditory and visual sequences: the synchronization threshold and the benefits and costs of interval subdivision

Synchronization of finger taps with an isochronous event sequence becomes difficult when the event rate exceeds a certain limit. In Experiment 1, the synchronization threshold was reached at interonset intervals (IOIs) above 100 ms with auditory tone sequences (in a 1:4 tapping task) but at IOIs above 400 ms with visual flash sequences (1:1 tapping). Using IOIs above those limits, the author investigated in Experiment 2 the reduction in the variability of asynchronies that tends to occur when the intervals between target events are subdivided by additional identical events (1:1 vs. 1:n tapping). The subdivision benefit was found to decrease with IOI duration and to turn into a cost at IOIs of 200-250 ms in auditory sequences and at IOIs of 450-500 ms in visual sequences. The auditory results are relevant to the limits of metrical subdivision and beat rate in music. The visual results demonstrate the remarkably weak rhythmicity of (nonmoving) visual stimuli.     

Rate Limits in Sensorimotor Synchronization With Auditory and Visual Sequences: The Synchronization Threshold and the Benefits and Costs of Interval Subdivision

Synchronization of finger taps with an isochronous event sequence becomes difficult when the event rate exceeds a certain limit. In Experiment 1, the synchronization threshold was reached at interonset intervals (IOIs) above 100 ms with auditory tone sequences (in a 1:4 tapping task) but at IOIs above 400 ms with visual flash sequences (1:1 tapping). Using IOIs above those limits, the author investigated in Experiment 2 the reduction in the variability of asynchronies that tends to occur when the intervals between target events are subdivided by additional identical events (1:1 vs 1:n tapping). The subdivision benefit was found to decrease with IOI duration and to turn into a cost at IOIs of 200–250 ms in auditory sequences and at IOIs of 450–500 ms in visual sequences. The auditory results are relevant to the limits of metrical subdivision and beat rate in music. The visual results demonstrate the remarkably weak rhythmicity of (nonmoving) visual stimuli.     

On the nature of phase attraction in sensorimotor synchronization with interleaved auditory sequences

In a task that requires in-phase synchronization of finger taps with an isochronous sequence of target tones that is interleaved with a sequence of distractor tones at various fixed phase relationships, the taps tend to be attracted to the distractor tones, especially when the distractor tones closely precede the target tones [Repp, B. H. (2003a). Phase attraction in sensorimotor synchronization with auditory sequences: Effects of single and periodic distractors on synchronization accuracy. Journal of Experimental Psychology: Human Perception and Performance, 29, 290-309]. The present research addressed two related questions about this distractor effect: (1) Is it a function of the absolute temporal separation or of the relative phase of the two stimulus sequences? (2) Is it the result of perceptual grouping (integration) of target and distractor tones or of simultaneous attraction to two independent sequences? In three experiments, distractor effects were compared across two different sequence rates. The results suggest that absolute temporal separation, not relative phase, is the critical variable. Experiment 3 also included an anti-phase tapping task that addressed the second question directly. The results suggest that the attraction of taps to distractor tones is caused mainly by temporal integration of target and distractor tones within a fixed window of 100-150 ms duration, with the earlier-occurring tone being weighted more strongly than the later-occurring one.     

To the beat of your own drum: Cortical regularization of non-integer ratio rhythms toward metrical patterns

Humans perceive a wide range of temporal patterns, including those rhythms that occur in music, speech, and movement; however, there are constraints on the rhythmic patterns that we can represent. Past research has shown that sequences in which sounds occur regularly at non-metrical locations in a repeating beat period (non-integer ratio subdivisions of the beat, e.g. sounds at 430 ms in a 1000 ms beat) are represented less accurately than sequences with metrical relationships, where events occur at even subdivisions of the beat (integer ratios, e.g. sounds at 500 ms in a 1000 ms beat). Why do non-integer ratio rhythms present cognitive challenges? An emerging theory is that non-integer ratio sequences are represented incorrectly, “regularized” in the direction of the nearest metrical pattern, and the present study sought evidence of such perceptual regularization toward integer ratio relationships. Participants listened to metrical and non-metrical rhythmic auditory sequences during electroencephalogram recording, and sounds were pseudorandomly omitted from the stimulus sequence. Cortical responses to these omissions (omission elicited potentials; OEPs) were used to estimate the timing of expectations for omitted sounds in integer ratio and non-integer ratio locations. OEP amplitude and onset latency measures indicated that expectations for non-integer ratio sequences are distorted toward the nearest metrical location in the rhythmic period. These top-down effects demonstrate metrical regularization in a purely perceptual context, and provide support for dynamical accounts of rhythm perception.     

The transition from synchronization to continuation tapping

The present study examined changes in timing at the transition from synchronization to continuation tapping and the role played by knowledge of the transition. Three experiments employed a pseudo-synchronization paradigm: At the transition, the pacing tones were replaced by identical feedback tones. In Experiment 1, participants were not informed when the transition would occur. Immediately following the transition, an acceleration of tapping was observed. In Experiment 2, participants were informed about the exact position of the transition, which was in addition marked by a pitch change. Nonetheless, the same acceleration occurred. Experiment 3 dissociated the actual from the expected position of the transition, without changing the results. In addition, the delay of the feedback tones was manipulated and was found to affect the rate of tapping in the continuation phase. A single delayed tone at the transition had no lasting effect, however. The results are interpreted in light of the synchronization-continuation model of Vorberg and Wing [Vorberg, D., & Wing, A. (1996). Modelling variability and dependence in timing. In H. Heuer, & S. W. Keele (Eds.), Handbook of perception and action, Vol. 2 (pp. 181-262). San Diego: Academic Press], with the added assumption that the synchronization tapping strategy is maintained in the continuation phase.     

Binaural integration of melodic patterns

It has been argued that there is a limit to the rate at which we can switch attention between ears in monitoring auditory information. Listeners identified melodic configurations formed by rapid sequences of tones. When these sequences were presented binaurally, excellent performance was obtained. Yet when the component tones of the melody were distributed between the ears, performance was largely nullified when a drone (i.e., a lower constantfrequency tone) was presented to the ear opposite that receiving the melody component. This improvement in performance cannot be attributed to processing the harmonic relationships between melody and drone, since when, instead, the drone was presented to the same ear as the melody component, performance was at chance. Onset-offset asynchronies between the drone and melody components resulted in performance levels between those where the drone and melody components were synchronous and those where the melody switched between ears without an accompanying drone. It is argued that difficulties in binaural integration are due not to processing limitations, but to a mechanism that is invoked under certain conditions to prevent confusion in monitoring individual sound sources.     

Time course of melody recognition: a gating paradigm study

Recognizing a well-known melody (e.g., one's national anthem) is not an all-or-none process. Instead, recognition develops progressively while the melody unfolds over time. To examine which factors govern the time course of this recognition process, the gating paradigm, initially designed to study auditory word recognition, was adapted to music. Musicians and nonmusicians were presented with segments of increasing duration of familiar and unfamiliar melodies (i.e., the first note, then the first two notes, then the first three notes, and so forth). Recognition was assessed after each segment either by requiring participants to provide a familiarity judgment (Experiment 1) or by asking them to sing the melody that they thought had been presented (Experiment 2). In general, the more familiar the melody, the fewer the notes required for recognition. Musicians judged music's familiarity within fewer notes than did nonmusicians, whereas the reverse situation (i.e., musicians were slower than nonmusicians) occurred when a sung response was requested. However, both musicians and nonmusicians appeared to segment melodies into the same perceptual units (i.e., motives) in order to access the correct representation in memory. These results are interpreted in light of the cohort model (Marslen-Wilson, 1987), as applied to the music domain.     

The ability to tap to a beat relates to cognitive,linguistic, and perceptual skills

Reading-impaired children have difficulty tapping to a beat. Here we tested whether this relationship between reading ability and synchronized tapping holds in typically-developing adolescents. We also hypothesized that tapping relates to two other abilities. First, since auditory-motor synchronization requires monitoring of the relationship between motor output and auditory input, we predicted that subjects better able to tap to the beat would perform better on attention tests. Second, since auditory-motor synchronization requires fine temporal precision within the auditory system for the extraction of a sound’s onset time, we predicted that subjects better able to tap to the beat would be less affected by backward masking, a measure of temporal precision within the auditory system. As predicted, tapping performance related to reading, attention, and backward masking. These results motivate future research investigating whether beat synchronization training can improve not only reading ability, but potentially executive function and auditory processing as well.     

Similarity-based restoration of metrical information: different listening experiences result in different perceptual inferences

How do perceivers apply knowledge to instances they have never experienced before? On one hand, listeners might use idealized representations that do not contain specific details. On the other, they might recognize and process information based on more detailed memory representations. The current study examined the latter possibility with respect to musical meter perception, previously thought to be computed based on highly-idealized (isochronous) internal representations. In six experiments, listeners heard sets of metrically-ambiguous melodies. Each melody was played in a simultaneous musical context with unambiguous metrical cues (3/4 or 6/8). Cross-melody similarity was manipulated by pairing certain cues-timbre (musical instrument) and motif content (2-6-note patterns)-with each meter, or distributing cues across meters. After multiple exposures, listeners heard each melody without context, and judged metrical continuations (all Experiments) or familiarity (Experiments 5-6). Responses were assessed for "metrical restoration"-the tendency to make metrical judgments that fit the melody's previously-heard metrical context. Cross-melody similarity affected the presence and degree of metrical restoration, and timbre affected familiarity. Results suggest that metrical processing may be calculated based on fairly detailed representations rather than idealized isochronous pulses, and is dissociated somewhat from familiarity judgments. Implications for theories of meter perception are discussed.     

Do local properties function as cues for musical key perception?1

Abstract: A global property (i.e., pitch set) of a melody appears to serve as a primary cue for key identification. Previous studies have proposed specific local properties in a melody (e.g., the augmented fourth, the perfect fifth, etc.) that may function as further cues. However, the role of the latter in key identification is controversial. The present study was designed to investigate what kinds of local properties, if any, function as reliable cues for key identification. Listeners were asked to identify keys for 450 melodies that consisted of the same pitch set, but which differed in sequential constraints. Using multiple discriminant analyses, we evaluated relative contributions of as many kinds of local properties as possible (e.g., single intervals, single pitch classes in each sequential position, etc.). The results showed that, except for the pitch class of the final tone, for which interpretation should be taken cautiously, none of the specific local properties examined contributed significantly to key identification. This finding suggests that, contrary to prior findings, key identification is derived from unidentified properties other than the specific local properties.     

On marching to two different drummers: perceptual aspects of the difficulties

People have remarkable difficulty generating two responses that must follow different temporal sequences, unless the temporal patterns are simply related (e.g., periods in 2:1, 3:1 relation). For example, it is hard to tap to two conflicting rhythms presented concurrently (i.e., a polyrhythm) using the right and left hands (Klapp, 1979), or to tap while articulating a conflicting speech utterance (Klapp, 1981). The present experiments indicate that difficulties in processing conflicting rhythms occur even when people must (a) merely monitor the stimuli and indicate the termination of one rhythmic sequence or (b) tap with a single hand. Responding to polyrhythms is thus difficult even without multiple limb coordination. Furthermore, the difficulty of two-handed tapping to polyrhythms that involve two different tones was found to decrease as the pitch difference between the tones was decreased. This result indicates that the difficulty of rhythmic coordination can be perceptually manipulated in a striking fashion. Polyrhythmic performance thus provides an excellent opportunity for examining possible interactions of perceptual and motor organizations.     

Circle drawing does not exhibit auditory-motor synchronization

Differences in timing control processes between tapping and circle drawing have been extensively documented during continuation timing. Differences between event and emergent control processes have also been documented for synchronization timing using emergent tasks that have minimal event-related information. However, it is not known whether the original circle-drawing task also behaves differently than tapping during synchronization. In this experiment, 10 participants performed a table-tapping and a continuous circle-drawing task to an auditory metronome. Synchronization performance was assessed via the value and variability of asynchronies. Synchronization was substantially more difficult in circle drawing than in tapping. Participants drawing timed circles exhibited drift in synchronization error and did not maintain a consistent phase relationship with the metronome. An analysis of temporal anchoring revealed that timing to the timing target was not more accurate than timing to other locations on the circle trajectory. The authors conclude that participants were not able to synchronize movement with metronome tones in the circle-drawing task despite other findings that cyclical tasks do exhibit auditory motor synchronization, because the circle-drawing task is unique and absent of event and cycle position information.     

Process timing and its relation to the coding of tonal harmony

Advances in auditory research suggest that gamma-band synchronization of frequency-specific cortical loci could be responsible for the integration of pure tones (harmonics) into harmonic complex tones. Thus far, evidence for such a mechanism has been revealed in neurophysiological studies, with little corroborative psychophysical evidence. In six experiments, we observed a rate- and time-specific response-time advantage for a sequence of target pips when the defining frequency of the target was a fractional multiple of a priming frequency. The effect was only observed when the prime and target sequences were presented at 33 pips per second and when the interstimulus interval was approximately 100 and 250 ms. This evidence implicates oscillatory gamma-band activity in the representation of harmonic complex tones and suggests that synchronization with precise temporal characteristics is important for disambiguating related harmonic templates. An outline of a model is presented, which accounts for these findings in terms of fast resynchronization of relevant neuronal assemblies.