Culture-general and culture-specific factors in the discrimination of melodies.

We examined effects of a culture-general factor, pattern redundancy (number of repeated tones), on the discrimination of 5-tone melodies that differed in their adherence to Western tonal conventions. Experiment 1 evaluated the ability of 9-month-old infants to differentiate "standard" melodies from subtly altered "comparison" melodies. Greater redundancy of the standard melodies was associated with enhanced infant performance, but musical conventionality had no effect. Experiment 2 evaluated comparable abilities in 5-year-old children and musically untrained adults. Children's performance was enhanced by the redundancy of standard melodies, but the effect was greater in conventional than in unconventional contexts. The redundancy of standard melodies facilitated adults' performance in conventional but not in unconventional contexts. Thus, increasing musical exposure seems to attenuate the effects of culture-general factors such as pattern redundancy while amplifying the influence of culture-specific factors.     

An interval size illusion: the influence of timbre on the perceived size of melodic intervals

In four experiments, we investigated the influence of timbre on perceived interval size. In Experiment 1, musically untrained participants heard two successive tones and rated the pitch distance between them. Tones were separated by six or seven semitones and varied in timbre. Pitch changes were accompanied by a congruent timbre change (e.g., ascending interval involving a shift from a dull to a bright timbre), an incongruent timbre change (e.g., ascending interval involving a shift from a bright to a dull timbre), or no timbre change. Ratings of interval size were strongly influenced by timbre. The six-semitone interval with a congruent timbre change was perceived to be larger than the seven-semitone interval with an incongruent timbre change (interval illusion). Experiment 2 revealed similar effects for musically trained participants. In Experiment 3, participants compared the size of two intervals presented one after the other. Effects of timbre were again observed, including evidence of an interval illusion. Experiment 4 confirmed that timbre manipulations did not distort the perceived pitch of tones. Changes in timbre can expand or contract the perceived size of intervals without distorting individual pitches. We discuss processes underlying interval size perception and their relation to pitch perception mechanisms.     

Enhanced development of auditory change detection in musically trained school‐aged children: a longitudinal event‐related potential study

Adult musicians show superior auditory discrimination skills when compared to non‐musicians. The enhanced auditory skills of musicians are reflected in the augmented amplitudes of their auditory event‐related potential (ERP) responses. In the current study, we investigated longitudinally the development of auditory discrimination skills in musically trained and nontrained individuals. To this end, we recorded the mismatch negativity (MMN) and P3a responses from children who play a musical instrument and age‐matched children with no musical training at ages 7, 9, 11, and 13. Basic auditory processing was investigated by recording ERPs in the Multi‐Feature Paradigm that included frequency, duration, intensity, location, and gap deviants. The detection of musically more relevant sound changes was examined in an oddball paradigm with major chords as standards and minor chords as deviants. The musically trained children showed larger increase in MMN and P3a amplitudes with age for the chord deviants than the control children. There was also a strong trend (p = .054) for larger increase in MMN amplitude in the musically trained children for the location deviant. As no group differences in response amplitudes were evident at the early stages of the training, our results suggest that the superior neural auditory discrimination in adult musicians is due to training and not pre‐existing differences between musicians and non‐musicians.     

Variability and recognition memory: Are there analogous indexical effects in music and speech?

Indexical effects refer to the influence of surface variability of the to-be-remembered items, such as different voices speaking the same words or different timbres (musical instruments) playing the same melodies, on recognition memory performance. The nature of timbre effects in melody recognition was investigated in two experiments. Experiment 1 showed that melodies that remained in the same timbre from study to test were discriminated better than melodies presented in a previously studied but different, or unstudied timbre at test. Timbre effects are attributed solely to instance-specific matching, rather than timbre-specific familiarity. In Experiment 2, when a previously unstudied timbre was similar to the original timbre and it played the melodies at test, performance was comparable to the condition when the exact same timbre was repeated at test. The use of a similar timbre at test enabled the listener to discriminate old from new melodies reliably. Overall, our data suggest that timbre-specific information is encoded and stored in long-term memory. Analogous indexical effects arising from timbre (nonmusical) and voice (nonlexical) attributes in music and speech processing respectively are implied and discussed.     

Children's perception of certain musical properties: scale and contour

Children's perception of scale and contour in melodies was investigated in five studies. Experimental tasks included judging transposed renditions of melodies (Studies 1 and 3), discriminating between transposed renditions of a melody (Study 2), judging contour-preserving transformations of melodies (Study 4), and judging similarity to a familiar target melody of transformations preserving rhythm or rhythm and contour (Study 5). The first and second studies showed that young children detect key transposition changes even in familiar melodies and they perceive similarity over key transpositions even in unfamiliar melodies. Young children also are sensitive to melodic contour over transformations that preserve it (Study 5), yet they distinguish spontaneously between melodies with the same contour and different intervals (Study 4). The key distance effect reported in the literature did not occur in the tasks of this investigation (Studies 1 and 3), and it may be apparent only for melodies shorter or more impoverished than those used here.     

Articulation effects in melody recognition memory

Various surface features—timbre, tempo, and pitch—influence melody recognition memory, but articulation format effects, if any, remain unknown. For the first time, these effects were examined. In Experiment 1, melodies that remained in the same, or appeared in a different but similar, articulation format from study to test were recognized better than were melodies that were presented in a distinct format at test. A similar articulation format adequately induced matching processes to enhance recognition. Experiment 2 revealed that melodies rated as perceptually dissimilar on the basis of the location of the articulation mismatch did not impair recognition performance, suggesting an important boundary condition for articulation format effects on memory recognition—the matching of the memory trace and recognition probe may depend more on the overall proportion, rather than the temporal location, of the mismatch. The present findings are discussed in terms of a global matching advantage hypothesis.     

Effects of timbre and tempo change on memory for music

We investigated the effects of different encoding tasks and of manipulations of two supposedly surface parameters of music on implicit and explicit memory for tunes. In two experiments, participants were first asked to either categorize instrument or judge familiarity of 40 unfamiliar short tunes. Subsequently, participants were asked to give explicit and implicit memory ratings for a list of 80 tunes, which included 40 previously heard. Half of the 40 previously heard tunes differed in timbre (Experiment 1) or tempo (Experiment 2) in comparison with the first exposure. A third experiment compared similarity ratings of the tunes that varied in timbre or tempo. Analysis of variance (ANOVA) results suggest first that the encoding task made no difference for either memory mode. Secondly, timbre and tempo change both impaired explicit memory, whereas tempo change additionally made implicit tune recognition worse. Results are discussed in the context of implicit memory for nonsemantic materials and the possible differences in timbre and tempo in musical representations.     

Binding “what” and “where” in auditory working memory: An asymmetrical association between sound identity and sound location

Contrasting results in visual and auditory working memory studies suggest that the mechanisms of association between location and identity of stimuli depend on the sensory modality of the input. In this auditory study, we tested whether the association of two features both encoded in the “what” stream is different from the association between a “what” and a “where” feature. In an old–new recognition task, blindfolded participants were presented with sequences of sounds varying in timbre, pitch and location. They were required to judge if either the timbre, pitch or location of a single-probe stimulus was identical or different to the timbre, pitch or location of one of the sounds of the previous sequence. Only variations in one of the three features were relevant for the task, whereas the other two features could vary, with task-irrelevant changes. Results showed that task-irrelevant variations in the “what” features (either timbre or pitch) caused an impaired recognition of sound location and in the other task-relevant “what” feature, whereas changes in sound location did not affect the recognition of either one of the “what” features. We conclude that the identity of sounds is incidentally processed even when not required by the task, whereas sound location is not maintained when task irrelevant.     

Infants’ perception of musical patterns

This paper examines infants’ ability to perceive various aspects of musical material that are significant in music in general and in Western European music in particular: contour, intervals, exact pitches, diatonic structure, and rhythm. For the most part, infants focus on relational aspects of melodies, synthesizing global representations from local details. They encode the contour of a melody across variations in exact pitches and intervals. They extract information about pitch direction from the smallest musically relevant pitch change in Western music, the semitone. Under certain conditions, infants detect interval changes in the context of transposed sequences, their performance showing enhancement for sequences that conform to Western musical structure. Infants have difficulty retaining exact pitches except for sets of pitches that embody important musical relations. In the temporal domain, they group the elements of auditory sequences on the basis of similarity and they extract the temporal structure of a melody across variations in tempo.     

Exposure effects on music preference and recognition

In three experiments, the effects of exposure to melodies on their subsequent liking and recognition were explored. In each experiment, the subjects first listened to a set of familiar and unfamiliar melodies in a study phase. In the subsequent test phase, the melodies were repeated, along with a set of distractors matched in familiarity. Half the subjects were required to rate their liking of each melody, and half had to identify the melodies they had heard earlier in the study phase. Repetition of the studied melodies was found to increase liking of the unfamiliar melodies in the affect task and to be best for detection of familiar melodies in the recognition task (Experiments 1, 2, and 3). These memory effects were found to fade at different time delays between study and test in the affect and recognition tasks, with the latter leading to the most persistent effects (Experiment 2). Both study-to-test changes in melody timbre and manipulation of study tasks had a marked impact on recognition and little influence on liking judgments (Experiment 3). Thus, all manipulated variables were found to dissociate the memory effects in the two tasks. The results are consistent with the view that memory effects in the affect and recognition tasks pertain to the implicit and explicit forms of memory, respectively. Part of the results are, however, at variance with the literature on implicit and explicit memory in the auditory domain. Attribution of these differences to the use of musical material is discussed.     

The beneficial effect of synchronized action on motor and perceptual timing in children

We examined the role of action in motor and perceptual timing across development. Adults and children aged 5 or 8 years old learned the duration of a rhythmic interval with or without concurrent action. We compared the effects of sensorimotor versus visual learning on subsequent timing behaviour in three different tasks: rhythm reproduction (Experiment 1), rhythm discrimination (Experiment 2) and interval discrimination (Experiment 3). Sensorimotor learning consisted of sensorimotor synchronization (tapping) to an isochronous visual rhythmic stimulus (ISI = 800 ms), whereas visual learning consisted of simply observing this rhythmic stimulus. Results confirmed our hypothesis that synchronized action during learning systematically benefitted subsequent timing performance, particularly for younger children. Action‐related improvements in accuracy were observed for both motor and perceptual timing in 5 years olds and for perceptual timing in the two older age groups. Benefits on perceptual timing tasks indicate that action shapes the cognitive representation of interval duration. Moreover, correlations with neuropsychological scores indicated that while timing performance in the visual learning condition depended on motor and memory capacity, sensorimotor learning facilitated an accurate representation of time independently of individual differences in motor and memory skill. Overall, our findings support the idea that action helps children to construct an independent and flexible representation of time, which leads to coupled sensorimotor coding for action and time.     

The time course of recognition of novel melodies

Seven experiments explored the time course of recognition of brief novel melodies. In a continuous-running-memory task, subjects recognized melodic transpositions following delays up to 2.0 min. The delays were either empty or filled with other melodies. Test items included exact transpositions (T), same-contour lures (SC) with altered pitch intervals, and different-contour lures (DC). DCs differed from Ts in the pattern of ups and downs of pitch. With this design, we assessed subjects’ discrimination of detailed changes in pitch intervals (T/SC discrimination) as well as their discrimination of contour changes (T/DC). We used both artificial and “real” melodies. Artificial melodies differed in conformity to a musical key, being tonal or atonal. After empty delays, T/DC discrimination was superior to T/SC discrimination. Surprisingly, after filled delays, T/SC discrimination was superior to T/DC. When only filled delays were tested, T/SC discrimination did not decline over the longest delays. T/DC performance declined more than did T/SC performance across both empty and filled delays. Tonality was an important factor only for T/SC discrimination after filled delays. T/DC performance was better with rhythmically intact folk melodies than with artificial isochronous melodies. Although T/SC performance improved over filled delays, it did not overtake T/DC performance. These results suggest that (1) contour and pitch-interval information make different contributions to recognition, with contour dominating performance after brief empty delays and pitch intervals dominating after longer filled delays; (2) a coherent tonality facilitates the encoding of pitch-interval patterns of melodies; and (3) the rich melodic—rhythmic contours of real melodies facilitate T/DC discrimination. These results are discussed in terms of automatic and controlled processing of melodic information.     

Memory for surface features of unfamiliar melodies: independent effects of changes in pitch and tempo

A melody’s identity is determined by relations between consecutive tones in terms of pitch and duration, whereas surface features (i.e., pitch level or key, tempo, and timbre) are irrelevant. Although surface features of highly familiar recordings are encoded into memory, little is known about listeners’ mental representations of melodies heard once or twice. It is also unknown whether musical pitch is represented additively or interactively with temporal information. In two experiments, listeners heard unfamiliar melodies twice in an initial exposure phase. In a subsequent test phase, they heard the same (old) melodies interspersed with new melodies. Some of the old melodies were shifted in key, tempo, or key and tempo. Listeners’ task was to rate how well they recognized each melody from the exposure phase while ignoring changes in key and tempo. Recognition ratings were higher for old melodies that stayed the same compared to those that were shifted in key or tempo, and detrimental effects of key and tempo changes were additive in between-subjects (Experiment 1) and within-subjects (Experiment 2) designs. The results confirm that surface features are remembered for melodies heard only twice. They also imply that key and tempo are processed and stored independently.     

Musical stem completion: humming that note

This study looked at how people store and retrieve tonal music explicitly and implicitly using a production task. Participants completed an implicit task (tune stem completion) followed by an explicit task (cued recall). The tasks were identical except for the instructions at test time. They listened to tunes and were then presented with tune stems from previously heard tunes and novel tunes. For the implicit task, they were asked to sing a note they thought would come next musically. For the explicit task, they were asked to sing the note they remembered as coming next. Experiment 1 found that people correctly completed significantly more old stems than new stems. Experiment 2 investigated the characteristics of music that fuel retrieval by varying a surface feature of the tune (same timbre or different timbre) from study to test and the encoding task (semantic or nonsemantic). Although we did not find that implicit and explicit memory for music were significantly dissociated for levels of processing, we did find that surface features of music affect semanticjudgments and subsequent explicit retrieval.     

Some influences of accent structure on melody recognition

Two experiments were carried out to investigate the roles of joint accent structure and familiarity in delayed recognition of relatively long tonal melodies. Melodic themes of target melodies were defined by correlating contour-related pitch accents with temporal accents (accent coupling) during an initial familiarization phase. Later, subjects gave recognition responses to key-transposed versions of the target melodies as well as to decoys with same and different contour accent patterns. In Experiment 1, all to-be-recognized melodies occurred both in an original rhythm, which preserved accent coupling, and in a new rhythm, which did not. Listeners were best at distinguishing targets from different decoys, especially in the original rhythm. In Experiment 2, the familiarity of target tunes and the rhythmic similarity in recognition were varied. Similar rhythms preserved accent coupling, whereas dissimilar rhythms did not. Listeners were most adept in distinguishing familiar targets from different decoys (Experiment 2A), particularly when they appeared in novel but similar rhythms. However, in similar rhythm conditions, listeners also frequently mistook same decoys for targets. With less familiar targets (Experiment 2B), these effects were attenuated, and performance showed general effects of pitch contour.     

Continuous loudness response to acoustic intensity dynamics in melodies: Effects of melodic contour,tempo, and tonality

The aim of this work was to investigate perceived loudness change in response to melodies that increase (up-ramp) or decrease (down-ramp) in acoustic intensity, and the interaction with other musical factors such as melodic contour, tempo, and tonality (tonal/atonal). A within-subjects design manipulated direction of linear intensity change (up-ramp, down-ramp), melodic contour (ascending, descending), tempo, and tonality, using single ramp trials and paired ramp trials, where single up-ramps and down-ramps were assembled to create continuous up-ramp/down-ramp or down-ramp/up-ramp pairs. Twenty-nine (Exp 1) and thirty-six (Exp 2) participants rated loudness continuously in response to trials with monophonic 13-note piano melodies lasting either 6.4 s or 12 s. Linear correlation coefficients > .89 between loudness and time show that time-series loudness responses to dynamic up-ramp and down-ramp melodies are essentially linear across all melodies. Therefore, ‘indirect’ loudness change derived from the difference in loudness at the beginning and end points of the continuous response was calculated. Down-ramps were perceived to change significantly more in loudness than up-ramps in both tonalities and at a relatively slow tempo. Loudness change was also greater for down-ramps presented with a congruent descending melodic contour, relative to an incongruent pairing (down-ramp and ascending melodic contour). No differential effect of intensity ramp/melodic contour congruency was observed for up-ramps. In paired ramp trials assessing the possible impact of ramp context, loudness change in response to up-ramps was significantly greater when preceded by down-ramps, than when not preceded by another ramp. Ramp context did not affect down-ramp perception. The contribution to the fields of music perception and psychoacoustics are discussed in the context of real-time perception of music, principles of music composition, and performance of musical dynamics.     

It's not what you play,it's how you play it: Timbre affects perception of emotion in music

Salient sensory experiences often have a strong emotional tone, but the neuropsychological relations between perceptual characteristics of sensory objects and the affective information they convey remain poorly defined. Here we addressed the relationship between sound identity and emotional information using music. In two experiments, we investigated whether perception of emotions is influenced by altering the musical instrument on which the music is played, independently of other musical features. In the first experiment, 40 novel melodies each representing one of four emotions (happiness, sadness, fear, or anger) were each recorded on four different instruments (an electronic synthesizer, a piano, a violin, and a trumpet), controlling for melody, tempo, and loudness between instruments. Healthy participants (23 young adults aged 18–30 years, 24 older adults aged 58–75 years) were asked to select which emotion they thought each musical stimulus represented in a four-alternative forced-choice task. Using a generalized linear mixed model we found a significant interaction between instrument and emotion judgement with a similar pattern in young and older adults (p < .0001 for each age group). The effect was not attributable to musical expertise. In the second experiment using the same melodies and experimental design, the interaction between timbre and perceived emotion was replicated (p < .05) in another group of young adults for novel synthetic timbres designed to incorporate timbral cues to particular emotions. Our findings show that timbre (instrument identity) independently affects the perception of emotions in music after controlling for other acoustic, cognitive, and performance factors.     

Imitation and representational development in young children with Down syndrome

Competence in object search and pretend play are argued to reflect young children's representational abilities and appear delayed in children with Down syndrome relative to social and imitative skills. This paper explores the effects on object search and play of this social strength in children with Down syndrome. Three experiments compared performance on traditional tasks with modified tasks designed to assess the role of imitation in object search and pretend play. Children with Down syndrome, relative to typically‐developing children, were able and willing to imitate hiding actions when no object was hidden (Experiment 1). When imitation was prevented in object search, children with Down syndrome searched less effectively than typically‐developing children (Experiment 2). In play, children with Down syndrome expressed more willingness to imitate a counter‐functional action, modelled by the experimenter, despite apparent competence in spontaneous functional play (Experiment 3). These findings indicate that object search and play behaviours of children with Down syndrome rely more heavily on imitation than is the case for typically‐developing children. The implications for the development of children with Down syndrome and models of representational development are discussed.     

A "voice inversion effect?"

Voice is the carrier of speech but is also an "auditory face" rich in information on the speaker's identity and affective state. Three experiments explored the possibility of a "voice inversion effect," by analogy to the classical "face inversion effect," which could support the hypothesis of a voice-specific module. Experiment 1 consisted of a gender identification task on two syllables pronounced by 90 speakers (boys, girls, men, and women). Experiment 2 consisted of a speaker discrimination task on pairs of syllables (8 men and 8 women). Experiment 3 consisted of an instrument discrimination task on pairs of melodies (8 string and 8 wind instruments). In all three experiments, stimuli were presented in 4 conditions: (1) no inversion; (2) temporal inversion (e.g., backwards speech); (3) frequency inversion centered around 4000 Hz; and (4) around 2500 Hz. Results indicated a significant decrease in performance caused by sound inversion, with a much stronger effect for frequency than for temporal inversion. Interestingly, although frequency inversion markedly affected timbre for both voices and instruments, subjects' performance was still above chance. However, performance at instrument discrimination was much higher than for voices, preventing comparison of inversion effects for voices vs. non-vocal stimuli. Additional experiments will be necessary to conclude on the existence of a possible "voice inversion effect."     

Representation and execution of vocal motor programs for expert singing of tonal melodies

Three experiments were conducted to study motor programs used by expert singers to produce short tonal melodies. Each experiment involved a response-priming procedure in which singers prepared to sing a primary melody but on 50% of trials had to switch and sing a different (secondary) melody instead. In Experiment 1, secondary melodies in the same key as the primary melody were easier to produce than secondary melodies in a different key. Experiment 2 showed that it was the initial note rather than key per se that affected production of secondary melodies. In Experiment 3, secondary melodies involving exact transpositions were easier to sing than secondary melodies with a different contour than the primary melody. Also, switches between the keys of C and G were easier than those between C and E. Taken together, these results suggest that the initial note of a melody may be the most important element in the motor program, that key is represented in a hierarchical form, and that melodic contour is represented as a series of exact semitone offsets.