Is it for real? Evaluating authenticity of musical pitch-space synesthesia

In spatial-sequence synesthesia, ordinal sequences are visualized in explicit spatial locations. We examined a recently documented subtype in which musical notes are represented in spatial configurations, to verify consistency and automaticity of musical pitch-space (M-S) synesthesia. An M-S synesthete performed a mapping pre-task (Exp. 1) used to indicate the locations of 7 auditory or visually presented notes, in 2 sessions a month apart. Results revealed strong correlations between sessions, suggesting the synesthete's musical forms were consistent over time. Experiment 2 assessed automaticity of M-S synesthesia. The same synesthete and matched controls preformed a spatial Stroop-like task. Participants were presented with an auditory or visual musical note and then had to reach for an asterisk (target) with a mouse cursor. The target appeared in a compatible or incompatible location (according to the synesthete's spatial representation). A compatibility effect was found for the synesthete but not for controls. The synesthete was significantly faster when the target appeared in compatible locations than in incompatible ones. Our findings show that for synesthetes, auditory and visually presented notes automatically trigger attention to specific spatial locations according to their specific M-S associations.     

Automatic motor activation by mere instruction

Previous behavioral studies have shown that instructions about stimulus–response (S-R) mappings can influence task performance even when these instructions are irrelevant for the current task. In the present study, we tested whether automatic effects of S–R instructions occur because the instructed stimuli automatically activate their corresponding responses. We registered the lateralized readiness potentials (LRPs) that were evoked by the instructed stimuli while participants were performing a task for which those mappings were irrelevant. Instructed S–R mappings clearly affected task performance in electrophysiological and behavioral measures. The LRP was found to deflect in the direction of the response tendency that corresponded with the instructed S–R mapping. Early activation of the instructed response was observed but occurred predominantly on slow trials. In contrast, response conflict evoked by instructed S–R mappings did not modulate the N2 amplitude. The results strongly suggest that, like experienced S–R mappings, instructed S–R mappings can lead to automatic response activation, but possibly via a different route.     

Mapping musical thought to musical performance

Expressive timing methods are described that map pianists' musical thoughts to sounded performance. In Experiment 1, 6 pianists performed the same musical excerpt on a computer-monitored keyboard. Each performance contained 3 expressive timing patterns: chord asynchronies, rubato patterns, and overlaps (staccato and legato). Each pattern was strongest in experienced pianists' performances and decreased when pianists attempted to play unmusically. In Experiment 2 pianists performed another musical excerpt and notated their musical intentions on an unedited score. The notated interpretations correlated with the presence of the 3 methods: The notated melody preceded other events in chords (chord asynchrony); events notated as phase boundaries showed greatest tempo changes (rubato); and the notated melody showed most consistent amount of overlap between adjacent events (staccato and legato). These results suggest that the mapping of musical thought to musical action is rule-governed, and the same rules produce different interpretations.     

Perception in action: The impact of sensory information on sensorimotor synchronization in musicians and non-musicians

The present study aimed at investigating to what extent sensorimotor synchronization is related to (i) musical specialization, (ii) perceptual discrimination, and (iii) the movement’s trajectory. To this end, musicians with different musical expertise (drummers, professional pianists, amateur pianists, singers, and non-musicians) performed an auditory and visual synchronization and a cross-modal temporal discrimination task. During auditory synchronization drummers performed less variably than amateur pianists, singers and non-musicians. In the cross-modal discrimination task drummers showed superior discrimination abilities which were correlated with synchronization variability as well as with the trajectory. These data suggest that (i) the type of specialized musical instrument affects synchronization abilities and (ii) synchronization accuracy is related to perceptual discrimination abilities as well as to (iii) the movement’s trajectory. Since particularly synchronization variability was affected by musical expertise, the present data imply that the type of instrument improves accuracy of timekeeping mechanisms.     

Action planning in sequential skills: Relations to music performance

The hypothesis that planning music-like sequential actions involves anticipating their auditory effects was investigated in a series of experiments. Participants with varying levels of musical experience responded to each of four colour-patch stimuli by producing a unique sequence of three taps on three vertically aligned keys. Each tap triggered a tone in most experimental conditions. Response–effect (key-to-tone) mapping was either compatible—taps on the top, middle, and bottom keys triggered high, medium, and low pitched tones, respectively—or incompatible—key-to-tone mapping was scrambled, reversed, or neutral (taps on different keys triggered the same tone). The results suggest that action planning was faster with compatible than with incompatible mappings (and faster than with no tones). Furthermore, the size of this compatibility effect grew with increasing musical experience, which suggests that improvements in auditory imagery ability that typically accompany musical training may augment the role of anticipatory auditory-effect representations during planning.     

Action planning in sequential skills: relations to music performance

The hypothesis that planning music-like sequential actions involves anticipating their auditory effects was investigated in a series of experiments. Participants with varying levels of musical experience responded to each of four colour-patch stimuli by producing a unique sequence of three taps on three vertically aligned keys. Each tap triggered a tone in most experimental conditions. Response-effect (key-to-tone) mapping was either compatible—taps on the top, middle, and bottom keys triggered high, medium, and low pitched tones, respectively—or incompatible—key-to-tone mapping was scrambled, reversed, or neutral (taps on different keys triggered the same tone). The results suggest that action planning was faster with compatible than with incompatible mappings (and faster than with no tones). Furthermore, the size of this compatibility effect grew with increasing musical experience, which suggests that improvements in auditory imagery ability that typically accompany musical training may augment the role of anticipatory auditory-effect representations during planning.     

Conceptual and motor learning in music performance

Are the mental plans for action abstract or specified in terms of the movements with which they are produced? We report motor independence for expert music performance but not for novice performance in a transfer-of-learning task. Skilled adult pianists practiced musical pieces and transferred to new pieces with the same or different motor (hand and finger) requirements and conceptual (melodic) relations. Greatest transfer in sequence duration was observed when the same conceptual relations were retained from training to transfer, regardless of motor movements. In a second experiment, novice child pianists performed the same task. More experienced child pianists showed transfer on both the motor and the conceptual dimensions; the least experienced child pianists demonstrated transfer only to sequences with identical motor and conceptual dimensions. These findings suggest that mental plans for action become independent of the required movements only at advanced skill levels.     

Influences of response position and hand posture on the orthogonal Simon effect

When lateralized responses are made to the locations of vertically arrayed stimuli, two types of mapping effect have been reported: an overall up-right/down-left advantage and mapping preferences that vary with response position. According to Cho and Proctor's (2003) multiple asymmetric codes account, these orthogonal stimulus-response compatibility effects are due to the correspondence of stimulus polarity and response polarity, as determined by the positions relative to multiple frames of reference. The present study examined these two types of orthogonal compatibility for situations in which participants made left-right responses to the colours of a vertically arrayed stimulus set, and stimulus location was irrelevant. Although a significant orthogonal Simon effect was not evident when responding at a centred, neutral response position, the effect was modulated by response eccentricity (Experiment 2) and hand posture (Experiment 3). These effects are qualitatively similar to those obtained when stimulus location is task relevant. The results imply that, as Proctor and Cho's (2006) polarity correspondence principle suggests, the stimulus polarity code activates the response code of corresponding polarity even when stimulus location is irrelevant to the task.     

Right-left prevalence effect with horizontal and vertical effectors

We investigated the right-left prevalence effect in spatial compatibility tasks by assessing subjects' performance on a two-dimensional task in which both the horizontal and vertical spatial dimensions were task relevant. Two experiments were performed, in which stimulus-response mappings were one-dimensional (Experiment 1) and two-dimensional (Experiment 2). The subjects responded by using either horizontal or vertical effectors to stimuli appearing in four possible locations. With the one-dimensional mapping, the spatial compatibility effect was present only in the dimension relevant to the mapping. With the two-dimensional mapping, the horizontal compatibility effect was always present, whereas the vertical compatibility effect was present only when vertical effectors were used. This pattern of results indicates that horizontal coding takes place with either horizontal or vertical effectors, whereas vertical coding takes place only when vertical effectors are used.     

Right—left prevalence effect with horizontal and vertical effectors

We investigated the right-left prevalence effect in spatial compatibility tasks by assessing subjects’ performance on a two-dimensional task in which both the horizontal and vertical spatial dimensions were task relevant. Two experiments were performed, in which stimulus-response mappings were one-dimensional (Experiment 1) and two-dimensional (Experiment 2). The subjects responded by using either horizontal or vertical effectors to stimuli appearing in four possible locations. With the one-dimensional mapping, the spatial compatibility effect was present only in the dimension relevant to the mapping. With the two-dimensional mapping, the horizontal compatibility effect was always present, whereas the vertical compatibility effect was present only when vertical effectors were used. This pattern of results indicates that horizontal coding takes place with either horizontal or vertical effectors, whereas vertical coding takes place only when vertical effectors are used.     

Task-defined associations are mode specific for selection of relevant dimension but mode independent for selection of location mapping

When compatible and incompatible mappings of a location-relevant task are mixed, or a location-relevant task is mixed with a task for which stimulus location is irrelevant, the benefit of the compatible mapping is eliminated for physical locations and enhanced for location words. Two experiments examined the influence of presenting the location information for the mixed conditions in different stimulus modes (physical location or word). Experiment 1 showed that the effects of mixing location-relevant and location-irrelevant tasks on the spatial compatibility and Simon effects are reduced when the location information is presented in different modes for the two tasks. Experiment 2 showed, in contrast, that the mode distinction had little influence on the effects of mixed compatible and incompatible mappings for location-relevant tasks: The compatibility effect was eliminated for physical locations and enhanced for words, as when there is no mode distinction. Thus, when location is relevant for one task and colour for the other, the task-defined associations of locations to responses are mode specific, but when location is relevant for both tasks, the associations are mode independent.     

Task-defined associations are mode specific for selection of relevant dimension but mode independent for selection of location mapping

When compatible and incompatible mappings of a location-relevant task are mixed, or a location-relevant task is mixed with a task for which stimulus location is irrelevant, the benefit of the compatible mapping is eliminated for physical locations and enhanced for location words. Two experiments examined the influence of presenting the location information for the mixed conditions in different stimulus modes (physical location or word). Experiment 1 showed that the effects of mixing location-relevant and location-irrelevant tasks on the spatial compatibility and Simon effects are reduced when the location information is presented in different modes for the two tasks. Experiment 2 showed, in contrast, that the mode distinction had little influence on the effects of mixed compatible and incompatible mappings for location-relevant tasks: The compatibility effect was eliminated for physical locations and enhanced for words, as when there is no mode distinction. Thus, when location is relevant for one task and colour for the other, the task-defined associations of locations to responses are mode specific, but when location is relevant for both tasks, the associations are mode independent.     

When hearing turns into playing: Movement induction by auditory stimuli in pianists

In this study, pianists were tested for learned associations between actions (movements on the piano) and their perceivable sensory effects (piano tones). Actions were examined that required the playing of two-tone sequences (intervals) in a four-choice paradigm. In Experiment 1, the intervals to be played were denoted by visual note stimuli. Concurrently with these imperative stimuli, task-irrelevant auditory distractor intervals were presented (“potential” action effects, congruent or incongruent). In Experiment 2, imperative stimuli were coloured squares, in order to exclude possible influences of spatial relationships of notes, responses, and auditory stimuli. In both experiments responses in the incongruent conditions were slower than those in the congruent conditions. Also, heard intervals actually “induced” false responses. The reaction time effects were more pronounced in Experiment 2. In nonmusicians (Experiment 3), no evidence for interference could be observed. Thus, our results show that in expert pianists potential action effects are able to induce corresponding actions, which demonstrates the existence of acquired action-effect associations in pianists.     

Effects of associative learning on age differences in task-set switching

Costs of switching between tasks may disappear when subjects are able to learn associations between tasks, stimuli, and responses (cf. Rogers, R. D., & Monsell, S. (1995). Costs of a predictable switch between simple cognitive tasks. Journal of Experimental Psychology: General, 124, 207-231). The first aim of this study was to examine this possibility by manipulating stimulus-set size. We expected that costs of switching between tasks would be strongly reduced under conditions of small stimulus-set sizes (n=4) as compared to large stimulus-set sizes (n=96) with increasing time on task. The second aim was to determine whether younger as well as older adults were able to create associations between task components. As age differences in task switching are often found to be larger when response mappings are incompatible we also investigated interactions with response compatibility. Results of our study indicated that practice effects on switch costs were much more pronounced for small than large stimulus-set sizes, consistent with the view that the strength of associations between task components facilitates task switching. Furthermore, we found that practice benefits on task switching for small stimulus-set sizes were sensitive to age and response compatibility. In contrast to younger adults, who showed a reduction of switch costs for both response mapping conditions, older adults showed a reduction of switch costs only when response mappings were compatible. That is, older adults showed less associative learning when the currently irrelevant task feature had to be suppressed, supporting the view that older adults have primarily problems in separating overlapping task-set representations.     

Pianists exhibit enhanced memory for vocal melodies but not piano melodies

Nonmusicians remember vocal melodies (i.e., sung to la la) better than instrumental melodies. If greater exposure to the voice contributes to those effects, then long-term experience with instrumental timbres should elicit instrument-specific advantages. Here we evaluate this hypothesis by comparing pianists with other musicians and nonmusicians. We also evaluate the possibility that absolute pitch (AP), which involves exceptional memory for isolated pitches, influences melodic memory. Participants heard 24 melodies played in four timbres (voice, piano, banjo, marimba) and were subsequently required to distinguish the melodies heard previously from 24 novel melodies presented in the same timbres. Musicians performed better than nonmusicians, but both groups showed a comparable memory advantage for vocal melodies. Moreover, pianists performed no better on melodies played on piano than on other instruments, and AP musicians performed no differently than non-AP musicians. The findings confirm the robust nature of the voice advantage and rule out explanations based on familiarity, practice, and motor representations.     

Influences of response position and hand posture on the orthogonal Simon effect

When lateralized responses are made to the locations of vertically arrayed stimuli, two types of mapping effect have been reported: an overall up–right/down–left advantage and mapping preferences that vary with response position. According to Cho and Proctor's (2003) multiple asymmetric codes account, these orthogonal stimulus–response compatibility effects are due to the correspondence of stimulus polarity and response polarity, as determined by the positions relative to multiple frames of reference. The present study examined these two types of orthogonal compatibility for situations in which participants made left–right responses to the colours of a vertically arrayed stimulus set, and stimulus location was irrelevant. Although a significant orthogonal Simon effect was not evident when responding at a centred, neutral response position, the effect was modulated by response eccentricity (Experiment 2) and hand posture (Experiment 3). These effects are qualitatively similar to those obtained when stimulus location is task relevant. The results imply that, as Proctor and Cho's (2006) polarity correspondence principle suggests, the stimulus polarity code activates the response code of corresponding polarity even when stimulus location is irrelevant to the task.     

Selecting mapping rules and responses in mixed compatibility four-choice tasks

Four-choice reaction tasks with a mixture of compatible and incompatible mappings were used to examine implications of the views that response selection occurs (a) in two stages (selection of the appropriate mapping rule, followed by application of the rule) and (b) by means of a second, direct route when the mappings for all possible stimuli are known to be compatible. All experiments showed, consistent with the two-stage view, that responses were faster and compatibility effects smaller when the mapping distinction corresponded to the left-right or inner-outer locations for the stimulus-response ensemble than when it did not. Moreover, precuing benefits tended to be larger when the cued responses had the same mapping than when they did not. There was an added benefit when both precued responses were compatible, rather than incompatible, consistent with the view that selection between compatible responses can proceed along a direct route. Received: 9 July 1997 / Accepted: 5 February 1998     

Tuning of diatonic scales by violinists,pianists, and nonmusicians

The present study shows that playing a particular musical instrument influences tuning preference. Violinists (n=7), pianists (n=7), and nonmusicians (n=10) were required to adjust three notes (E, A, and B) in computer-generated, eight-tone ascending and descending diatonic scales of C major. The results indicated that (1) violinists set the three tones closer to Pythagorean intonation than do pianists (p< .01), (2) pianists fit closest to equal-tempered intonation (p< .01), and (3) nonmusicians do not show any preference for a specific intonation model. These findings are consistent with the view that tuning preference is determined by musical experience more than by characteristics of the auditory system. The relevance of these results to theories of cultural conditioning and assessment of tonal perception is discussed.     

Manipulating response set in a choice reaction task: evidence for anatomical coding in response selection

Accurate motor performance requires a process of response selection that chooses the correct response out of a set of possible ones. Most theories of response selection assume that this selection process operates on spatial codes, which define the location of stimuli and responses in environmental coordinates, with little or no role for the anatomical codes of the effectors involved. In this study, I systematically manipulated the anatomical identities of the response fingers in a four-choice reaction task, while keeping the stimulus and response locations constant. Results showed that homologous fingers on different hands modulated the reaction time profiles and error patterns in a mirror-symmetrical way. This finding indicates that anatomical factors may play a more substantial role in response selection than often assumed.