Adaptation to tempo changes in sensorimotor synchronization: Effects of intention, attention, and awareness

Adaptation to tempo changes in sensorimotor synchronization is hypothesized to rest on two processes, one (phase correction) being largely automatic and the other (period correction) requiring conscious awareness and attention. In this study, participants tapped their finger in synchrony with auditory sequences containing a tempo change and continued tapping after sequence termination. Their intention to adapt or not to adapt to the tempo change was manipulated through instructions, their attentional resources were varied by introducing a concurrent secondary task (mental arithmetic), and their awareness of the tempo changes was assessed through perceptual judgements. As predicted, period correction was found to be strongly dependent on all three variables, whereas phase correction depended only on intention.     

Temporal control of movements in sensorimotor synchronization.

Under conditions in which the temporal structure of events (e.g., a sequence of tones) is predictable, performing movements in synchrony with this sequence of events (e.g., dancing) is an easy task. A rather simplified version of this task is studied in the sensorimotor synchronization paradigm. Participants are instructed to synchronize their finger taps with an isochronous sequence of signals (e.g., clicks). Although this is an easy task, a systematic error is observed: Taps usually precede clicks by several tens of milliseconds. Different models have been proposed to account for this effect ("negative asynchrony" or "synchronization error"). One group of explanations is based on the idea that synchrony is established at the level of central representations (and not at the level of external events), and that the timing of an action is determined by the (anticipated) action effect. These assumptions are tested by manipulating the amount of sensory feedback available from the tap as well as its temporal characteristics. This article presents an overview of these representational models and the empirical evidence supporting them. It also discusses other accounts briefly in the light of further evidence.     

Generalized sensorimotor adaptation with diminished feedback

Summary Adaptation to optical distortion was produced by viewing, through prisms, the trajectory of a dim point light source moved by the leg in an otherwise darkened room. The results show that such a minimal prism exposure condition produces adaptive sensorimotor shifts that alter 1. eye-foot coordination, entailing the contralateral and the ipsilateral leg, as well as 2. eye-hand coordination and 3. ego-centric localization. Generalization of adaptation produced by the minimal exposure condition was equal to that produced by the more customary prism exposure procedure, although its magnitude was somewhat smaller.This study was supported by an NIH-Biomedical grant from the University of Georgia.     

Increasing stimulus intensity does not affect sensorimotor synchronization

When people synchronize taps with isochronously presented stimuli, taps usually precede the pacing stimuli [negative mean asynchrony (NMA)]. One explanation of NMA [sensory accumulation model (SAM), Aschersleben in Brain Cogn 48:66–79, 2002] is that more time is needed to generate a central code for kinesthetic-tactile information than for auditory or visual stimuli. The SAM predicts that raising the intensity of the pacing stimuli shortens the time for their sensory accumulation, thereby increasing NMA. This prediction was tested by asking participants to synchronize finger force pulses with target isochronous stimuli with various intensities. In addition, participants performed a simple reaction-time task, for comparison. Higher intensity led to shorter reaction times. However, intensity manipulation did not affect NMA in the synchronization task. This finding is not consistent with the predictions based on the SAM. Discrepancies in sensitivity to stimulus intensity between sensorimotor synchronization and reaction-time tasks point to the involvement of different timing mechanisms in these two tasks.     

Phase correction in sensorimotor synchronization: nonlinearities in voluntary and involuntary responses to perturbations

When finger taps are synchronized with an auditory sequence, both a global phase shift (PS) and a local event onset shift (EOS) in the sequence elicit a phase correction response (PCR) on the next tap. The PCR to an expected PS is intended and large, whereas that to an expected EOS is unintended and smaller. PCR magnitude increases linearly with perturbation magnitude up to about +/-15% of the sequence period (500 milliseconds). With larger perturbations, voluntary PCRs increase more slowly whereas involuntary PCRs reach an asymptote. These results, obtained previously in a blocked design [J. Exp. Psychol. Human Percept. Perform. (in press)], were replicated in a randomized design and in two additional task contexts that varied participants' intentions while neutralizing their expectations. Neither design nor expectations seemed to play a role. However, considerable individual differences were noted. The results confirm that phase correction is partially automatic and partially subject to voluntary control, and they provide empirical estimates of error correction functions that may be useful in formal modeling of sensorimotor synchronization behavior.     

Rapid motor adaptations to subliminal frequency shifts during syncopated rhythmic sensorimotor synchronization

The synchronization of rhythmic arm movements to a syncopated metronome cue was studied in a step-change design whereby small tempo shifts were inserted at fixed time points into the metronome frequency. The cueing sequence involved three stimulus types: (1) target contact in synchrony with the metronome beats, (2) syncopated target contact midway in time between audible beats, and (3) syncopated target contact following either a +2% or -2% change in stimulus frequency. Analysis of normalized and aggregated data revealed that (1) during the syncopation condition the response period showed a rapid adaptation to the frequency-incremented stimulus period, (2) response period was less variable during syncopated movement, (3) mean synchronization error and variability, calculated during syncopation relative to the mathematical midpoint of the stimulus cycle, were reduced during syncopated movements, and (4) synchronization error following the frequency increment showed trends to return linearly to pre-increment values which was fully achieved in the -2% change condition only. The results suggest that frequency entrainment to stimulus period was possible during syncopated movement with the response and stimulus onsets 180 degrees out of phase. Most remarkably, 70-80% of the adaptation of the response period to the new stimulus period was immediately attained during the second half cycle of the syncopated movement. Finally, a mathematical model, based on recursion, was introduced that accurately modeled actual data as a function of the previous stimulus and response intervals and a weighted response of period error and synchronization error, which showed dominance of frequency entrainment over phase entrainment during rhythmic synchronization.     

Multiple temporal references in sensorimotor synchronization with metrical auditory sequences

A local phase perturbation in an auditory sequence during synchronized finger tapping elicits an automatic phase correction response (PCR). The stimulus for the PCR is usually considered to be the most recent tap-tone asynchrony. In this study, participants tapped on target tones ("beats") of isochronous tone sequences consisting of beats and subdivisions (1:n tapping). A phase perturbation was introduced either on a beat or on a subdivision. Both types of perturbation elicited a PCR, even though there was no asynchrony associated with a subdivision. Moreover, the PCR to a perturbed beat was smaller when an unperturbed subdivision followed than when there was no subdivision. The relative size of the PCRs to perturbed beats and subdivisions depended on tempo, on whether the subdivision was local or present throughout the sequence, and on whether or not participants engaged in mental subdivision, but not on whether or not taps were made on the subdivision level. The results show that phase correction in synchronization depends not merely on asynchronies but on perceptual monitoring of multiple temporal references within a metrical hierarchy.     

Proprioception plays a different role for sensorimotor adaptation to different distortions

If proprioceptive feedback is degraded by agonist-antagonist muscle vibration, then adaptation to rotated vision remains intact while adaptation to a velocity-dependent force field worsens. Here we evaluate whether this differential effect of vibration is related to the physical nature of the distortion - visual versus mechanical - or to their kinematic coupling to the subjects’ hand - velocity versus position dependent. Subjects adapted to a velocity-dependent visual distortion, to a position-dependent force, or to a velocity-dependent force; one half of the subjects adapted with, and the other half without agonist-antagonist vibration at the wrist, elbow, and shoulder. We found, as before, that vibration slowed down adaptation to a velocity-dependent force. However, vibration did not modify adaptation to the other two distortions, nor did it influence the aftereffects of any distortion. From this we conclude that intact proprioception supports strategic compensatory processes when proprioceptive signals agree with visual ones, and provide relevant (dynamic) information not available to the visual system.     

Difference in sensorimotor adaptation to horizontal and vertical mirror distortions during ballistic arm movements

When learning a novel motor task, the sensorimotor system must develop new strategies to efficiently control the limb(s) involved, and this adaptation appears to be developed through the construction of a behavioral map known as an 'internal model'. A common method to uncover the mechanisms of adaptation and reorganization processes is to expose the system to new environmental conditions, typically by introducing visual or mechanical distortions. The present study investigated the adaptation mechanisms of the human sensorimotor system to horizontal and vertical mirror distortions (HMD and VMD) during the execution of fast goal-directed arm movements. Mirror distortions (MDs) were created by means of virtual visual feedback on a computer screen while the movement was executed on a graphics tablet. Twenty healthy adult participants were recruited and assigned to one of two groups of 10 people each. Tests were divided in two subsequent blocks of five trials. The first block consisted of trials with no mirror distortion (NMD), while the second block was recorded when exposing one group to HMD and the other to VMD. Both MDs resulted in kinematic changes: during the tests with the MDs the participants did not reach the performance level found at the NMD test. Motor performance during HMD appeared to be globally better than during VMD and the adaptation process to VMD appeared to be slower than to HMD, but data interpretation was hampered by large within-participant and between-participant variability. In-depth analyses of the data revealed that most of the motor performance information was contained in the direction of movement. The data supported the idea that the internal model for HMD was already partially built.     

Perception of timing is more context sensitive than sensorimotor synchronization

In three experiments, the effects of contextual temporal variation on the perception of timing and on sensorimotor synchronization were examined. Experiment 1 showed that exposure to a variably timed auditory precursor sequence reduces the detectability of deviations from isochrony in a musical test sequence. By contrast, in Experiment 2 there was only a small and transient effect of identical precursor sequences on the variability of finger taps that were synchronized with a similar test sequence. Moreover, the precursor did not impede phase error correction following deviations from isochrony in the test sequence. Experiment 3 employed a within-subjects design that required simultaneous detection of irregularities in and synchronization with nonmusical auditory sequences. Precursor variability impaired only detection, not synchronization performance. These results suggest that perception of deviations from regularity engages context-sensitive tining processes, probably related to conscious awareness, that are not involved in sensorimotor synchronization.     

Development of sensorimotor synchronization abilities: Motor and cognitive components

The aim of the present study was to examine both the development of sensorimotor synchronization in children in the age range from 5 to 8 years and the involvement of motor and cognitive capacities. Children performed a spontaneous motor tempo task and a synchronization–continuation task using an external auditory stimulus presented at three different inter-stimulus intervals: 500, 700, and 900 ms. Their motor and cognitive abilities (short-term memory, working memory, and attention) were also assessed with various neuropsychological tests. The results showed some developmental changes in synchronization capacities, with the regularity of tapping and the ability to slow down the tapping rate improving with age. The age-related differences in tapping were nevertheless greater in the continuation phase than in the synchronization phase. In addition, the development of motor capacities explained the age-related changes in performance for the synchronization phase and the continuation phase, although working memory capacities were also involved in the interindividual differences in performance in the continuation phase. The continuation phase is thus more cognitively demanding than the synchronization phase. Consequently, the improvement in sensorimotor synchronization during childhood is related to motor development in the case of synchronization but also to cognitive development with regard to the reproduction and maintenance of the rhythm in memory.     

Quantifying phase correction in sensorimotor synchronization: empirical comparison of three paradigms

Tapping in synchrony with a metronome requires phase error correction, a process often described by a single-parameter autoregressive model. The parameter (α) is a measure of sensorimotor coupling strength. This study compares α estimates obtained from three experimental paradigms: synchronization with (1) a perfectly regular metronome (RM), (2) a perturbed metronome containing phase shifts (PS), and (3) an "adaptively timed" metronome (AT). Musically trained participants performed in each paradigm at four tempi, with baseline interval durations ranging from 400 to 1300 ms. Two estimation methods were applied to each data set. Results showed that all α estimates increased with interval duration. However, the PS paradigm yielded much larger α values than did the AT paradigm, with those from the RM paradigm falling in between. Positional analysis of the PS data revealed that α increased immediately following a phase shift and then decreased sharply. Unexpectedly, all PS α estimates were uncorrelated with the RM and AT estimates, which were strongly correlated. These results suggest that abruptly perturbed sequences engage a different mechanism of phase correction than do regular or continuously modulated sequences.     

Phase attraction in sensorimotor synchronization with auditory sequences: effects of single and periodic distractors on synchronization accuracy

Four experiments showed that both single and periodic distractor tones affected the timing of finger taps produced in synchrony with an isochronous auditory target sequence. Single distractors had only small effects, but periodic distractors occurring at various fixed or changing phase relationships exerted strong phase attraction. The attraction was asymmetric, being stronger when distractors preceded target tones than when they lagged behind. A large pitch difference between target and distractor tones (20 vs. 3 semitones) did not reduce phase attraction substantially, although in the case of continuously changing phase relationships it did prevent complete capture of the taps by the distractors. The results support the hypothesis that phase attraction is an automatic process that is sensitive primarily to event onsets.     

Processes underlying congruent and incongruent facial reactions to emotional facial expressions

The present electromyographic study is a first step toward shedding light on the involvement of affective processes in congruent and incongruent facial reactions to facial expressions. Further, empathy was investigated as a potential mediator underlying the modulation of facial reactions to emotional faces in a competitive, a cooperative, and a neutral setting. Results revealed less congruent reactions to happy expressions and even incongruent reactions to sad and angry expressions in the competition condition, whereas virtually no differences between the neutral and the cooperation condition occurred. Effects on congruent reactions were found to be mediated by cognitive empathy, indicating that the state of empathy plays an important role in the situational modulation of congruent reactions. Further, incongruent reactions to sad and angry faces in a competition setting were mediated by the emotional reaction of joy, supporting the assumption that incongruent facial reactions are mainly based on affective processes. Additionally, strategic processes (specifically, the goal to create and maintain a smooth, harmonious interaction) were found to influence facial reactions while being in a cooperative mindset. Now, further studies are needed to test for the generalizability of these effects.     

Processes underlying long-term repetition priming in digit data entry

Two experiments examined long-term repetition priming in data entry. In each experiment, participants entered 4-digit numbers displayed as either words or numerals, and responded with digits (Experiment 1), or either digits or initial letters (Experiment 2). At test 1 week later, they entered old and new numbers, with the format changed for half of the old stimuli. Implicit memory was evidenced at test by faster entry of the old than the new numbers, regardless of whether the numbers were in the same or different format, suggesting that the abstract numerical meaning, not the surface form, contributes to repetition priming. Numbers presented as words in training had an advantage over numbers presented as numerals, regardless of response format, implying that type of processing also contributes to the effect and ruling out an explanation based on time spent processing numbers in word format.     

On the nature of phase attraction in sensorimotor synchronization with interleaved auditory sequences

In a task that requires in-phase synchronization of finger taps with an isochronous sequence of target tones that is interleaved with a sequence of distractor tones at various fixed phase relationships, the taps tend to be attracted to the distractor tones, especially when the distractor tones closely precede the target tones [Repp, B. H. (2003a). Phase attraction in sensorimotor synchronization with auditory sequences: Effects of single and periodic distractors on synchronization accuracy. Journal of Experimental Psychology: Human Perception and Performance, 29, 290-309]. The present research addressed two related questions about this distractor effect: (1) Is it a function of the absolute temporal separation or of the relative phase of the two stimulus sequences? (2) Is it the result of perceptual grouping (integration) of target and distractor tones or of simultaneous attraction to two independent sequences? In three experiments, distractor effects were compared across two different sequence rates. The results suggest that absolute temporal separation, not relative phase, is the critical variable. Experiment 3 also included an anti-phase tapping task that addressed the second question directly. The results suggest that the attraction of taps to distractor tones is caused mainly by temporal integration of target and distractor tones within a fixed window of 100-150 ms duration, with the earlier-occurring tone being weighted more strongly than the later-occurring one.