Recognizing melodies: A dynamic interpretation

Two experiments explore hypotheses about rhythm and contour in recognition of simple pitch strings (melodies). Target melodies that differed with respect to pitch relationships (interval and contour pitch differences) and rhythm, were presented to ordinary listeners who were told to learn the melodies (Phase I). In a subsequent recognition test (Phase II), listeners had to recognize these same target melodies although they were transposed to a different musical key. In recognition, target melodies appeared in the original rhythm or in new rhythms that simulated some pause properties of the original rhythm. Target melodies were interspersed with decoy melodies that either preserved the pitch contour of targets or did not; all appeared in the original rhythm and in new rhythms. Results indicated that a new rhythmic context lowered recognizability of target melodies, and that decoys were most confusing when they possessed the same “dynamic shape” (contour-plus-rhythm) as targets (Experiment 1). Also, target recognition improved with Phase I familiarity (Experiment 2), although rhythmic shifts remained detrimental across levels of target familiarity. Confusions based on “dynamic shape” accounted for a relatively high proportion of errors where familiarity with targets is low. Findings were interpreted in terms of a theory of context-sensitive dynamic attending in which remembering is assumed to involve recapitulation of the original rhythmical activities involved in attending to melodies.     

Does rule recursion make melodies easier to reproduce? If not, what does?

Two experiments examined the effects of variations in melodic rule structure and rhythm upon the ability of musically sophisticated listeners to reproduce auditory patterns. These experiments were designed to evaluate different theoretical perspectives on auditory pattern perception and the role of rule structure in perceiving and remembering. Predictions of a coding model, which emphasizes the impact of rule recursion, were contrasted with those of an accent model, which emphasizes the relative timing of melodic and temporal accents. Effects of recursive (hierarchical) and nonrecursive (linear) rule arrangements were studied in contexts where pattern contour differences were controlled for. Rhythm was also varied. Measured pauses were inserted between certain tones to make a rhythm compatible or incompatible with melodic rule phrases. Experiment 1 showed that pattern simplicity was determined not by rule recursive codes, but by the number and timing of contour changes and melodic rule breaks. Experiment 2 examined additional effects of rhythm on listeners' response to rule recursion and melodic phrasing in melodies of equivalent contour. Although modest effects of rule recursion appeared, these effects were again outweighed by large performance differences due to the relative timing of changes in contour and melodic rule structure. Implications of the accent model for dynamic attending are discussed in the context of a new proposal involving temporal phasing of accents.     

Levels-of-processing effects on "remember" responses in recognition for familiar and unfamiliar tunes

We investigated the effect of level-of-processing manipulations on "remember" and "know" responses in episodic melody recognition (Experiments 1 and 2) and how this effect is modulated by item familiarity (Experiment 2). In Experiment 1, participants performed 2 conceptual and 2 perceptual orienting tasks while listening to familiar melodies: judging the mood, continuing the tune, tracing the pitch contour, and counting long notes. The conceptual mood task led to higher d' rates for "remember" but not "know" responses. In Experiment 2, participants either judged the mood or counted long notes of tunes with high and low familiarity. A level-of-processing effect emerged again in participants' "remember" d' rates regardless of melody familiarity. Results are discussed within the distinctive processing framework.     

The perception of interleaved melodies

If the notes of two melodies whose pitch ranges do not overlap are interleaved in time so that successive tones come from the different melodies, the resulting sequence of tones is perceptually divided into groups that correspond to the two melodies. Such “melodic fission” demonstrates perceptual grouping based on pitch alone, and has been used extensively in music.Experiment I showed that the identification of interleaved pairs of familiar melodies is possible if their pitch ranges do not overlap, but difficult otherwise. A short-term recognition-memory paradigm (Expt II) showed that interleaving a “background” melody with an unfamiliar melody interferes with same-different judgments regardless of the separation of their pitch ranges, but that range separation attenuates the interference effect. When pitch ranges overlap, listeners can overcome the interference effect and recognize a familiar target melody if the target is prespecified, thereby permitting them to search actively for it (Expt III). But familiarity or prespecification of the interleaved background melody appears not to reduce its interfering effects on same-different judgments concerning unfamiliar target melodies (Expt IV).     

Cross-accent intelligibility of speech in noise: Long-term familiarity and short-term familiarization

Listeners must cope with a great deal of variability in the speech signal, and thus theories of speech perception must also account for variability, which comes from a number of sources, including variation between accents. It is well known that there is a processing cost when listening to speech in an accent other than one's own, but recent work has suggested that this cost is reduced when listening to a familiar accent widely represented in the media, and/or when short amounts of exposure to an accent are provided. Little is known, however, about how these factors (long-term familiarity and short-term familiarization with an accent) interact. The current study tested this interaction by playing listeners difficult-to-segment sentences in noise, before and after a familiarization period where the same sentences were heard in the clear, allowing us to manipulate short-term familiarization. Listeners were speakers of either Glasgow English or Standard Southern British English, and they listened to speech in either their own or the other accent, thereby allowing us to manipulate long-term familiarity. Results suggest that both long-term familiarity and short-term familiarization mitigate the perceptual processing costs of listening to an accent that is not one's own, but seem not to compensate for them entirely, even when the accent is widely heard in the media.     

Effects of Lexical Prosody and Word Familiarity on Lexical Access of Spoken Japanese Words

Lexical prosody (e.g., stress and pitch accent) has been shown to constrain lexical activation of spoken words in various languages. In the present study, whether or not the constraint of lexical prosody is affected by word familiarity in lexical access of Japanese words was examined using a cross-modal priming task. The stimuli were pairs of prosodically different homophones (minimal accent pairs). When the targets were more familiar members of minimal accent pairs, the responses were facilitated by prior presentations of primes that were prosodically different homophones of the targets, suggesting that lexical prosody did not constrain lexical activation. In contrast, when less familiar members of minimal accent pairs were used as the targets, the prosodically different homophones did not facilitate the responses to the targets. These results suggest that the constraint of lexical prosody is not so strong but is affected by the factor of word relative familiarity.     

The role of melodic and temporal cues in perceiving musical meter

A number of different cues allow listeners to perceive musical meter. Three experiments examined effects of melodic and temporal accents on perceived meter in excerpts from folk songs scored in 6/8 or 3/4 meter. Participants matched excerpts with 1 of 2 metrical drum accompaniments. Melodic accents included contour change, melodic leaps, registral extreme, melodic repetition, and harmonic rhythm. Two experiments with isochronous melodies showed that contour change and melodic repetition predicted judgments. For longer melodies in the 2nd experiment, variables predicted judgments best at the beginning of excerpts. The final experiment, with rhythmically varied melodies, showed that temporal accents, tempo, and contour change were the strongest predictors of meter. The authors' findings suggest that listeners combine multiple melodic and temporal features to perceive musical meter.     

Children's perception of certain musical properties: scale and contour

Children's perception of scale and contour in melodies was investigated in five studies. Experimental tasks included judging transposed renditions of melodies (Studies 1 and 3), discriminating between transposed renditions of a melody (Study 2), judging contour-preserving transformations of melodies (Study 4), and judging similarity to a familiar target melody of transformations preserving rhythm or rhythm and contour (Study 5). The first and second studies showed that young children detect key transposition changes even in familiar melodies and they perceive similarity over key transpositions even in unfamiliar melodies. Young children also are sensitive to melodic contour over transformations that preserve it (Study 5), yet they distinguish spontaneously between melodies with the same contour and different intervals (Study 4). The key distance effect reported in the literature did not occur in the tasks of this investigation (Studies 1 and 3), and it may be apparent only for melodies shorter or more impoverished than those used here.     

Memory for surface features of unfamiliar melodies: independent effects of changes in pitch and tempo

A melody’s identity is determined by relations between consecutive tones in terms of pitch and duration, whereas surface features (i.e., pitch level or key, tempo, and timbre) are irrelevant. Although surface features of highly familiar recordings are encoded into memory, little is known about listeners’ mental representations of melodies heard once or twice. It is also unknown whether musical pitch is represented additively or interactively with temporal information. In two experiments, listeners heard unfamiliar melodies twice in an initial exposure phase. In a subsequent test phase, they heard the same (old) melodies interspersed with new melodies. Some of the old melodies were shifted in key, tempo, or key and tempo. Listeners’ task was to rate how well they recognized each melody from the exposure phase while ignoring changes in key and tempo. Recognition ratings were higher for old melodies that stayed the same compared to those that were shifted in key or tempo, and detrimental effects of key and tempo changes were additive in between-subjects (Experiment 1) and within-subjects (Experiment 2) designs. The results confirm that surface features are remembered for melodies heard only twice. They also imply that key and tempo are processed and stored independently.     

Memory advantage for produced words and familiar native accents

Our memory is better for words that we have read aloud than for words that we have read silently or have listened to. The present study tested this memory advantage for words with native accent markers that participants were either highly familiar or less familiar. As in previous studies, produced words were subsequently remembered better than listened-to words. In contrast to previous studies that involved a comparison of global foreign accents with standard native accents, in the present study words with highly familiar accent markers were remembered better than words with less familiar accent markers (Experiment 1). The familiar accent advantage was also found when participants could not hear their own productions during the training phase (Experiment 2). When tested with a week delay, produced words were still remembered better than listened-to words, but the advantage for words with familiar accent markers was no longer found (Experiment 3).     

Recognition of notated melodies by possessors and nonpossessors of absolute pitch

Musically trained listeners compared a notated melody presented visually and a comparison melody presented auditorily, and judged whether they were exactly the same or not, with respect to relative pitch. Listeners who had absolute pitch showed the poorest performance for melodies transposed to different pitch levels from the notated melodies, whereas they exhibited the highest performance for untransposed melodies. By comparison, the performance of melody recognition by listeners who did not have absolute pitch was not influenced by the actual pitch level at which melodies were played. These results suggest that absolute-pitch listeners tend to rely on absolute pitch even in recognizing transposed melodies, for which the absolute-pitch strategy is not useful.     

Recognition of notated melodies by possessors and nonpossessors of absolute pitch

Musically trained listeners compared a notated melody presented visually and a comparison melody presented auditorily, and judged whether they were exactly the same or not, with respect to relative pitch. Listeners who had absolute pitch showed the poorest performance for melodies transposed to different pitch levels from the notated melodies, whereas they exhibited the highest performance for untransposed melodies. By comparison, the performance of melody recognition by listeners who did not have absolute pitch was not influenced by the actual pitch level at which melodies were played. These results suggest that absolute-pitch listeners tend to rely on absolute pitch even in recognizing transposed melodies, for which the absolute-pitch strategy is not useful.     

Effects of metric and harmonic rhythm on the detection of pitch alterations in melodic sequences

Tested response time to alterations. Metric rhythm and harmonic rhythm of 13-note tonal sequences were either matched or mismatched. Metric rhythm (3/4 or 4/4 meter) was induced by dynamic accents. Harmonic rhythm was induced by implied chord progressions initiated on the first note and on either every third or every fourth note. Responses were not always faster for matched rhythms or for alterations occurring on the dynamic accent. Responses were consistently faster for sequences presented in 4/4 meter. Musically untrained Ss performed similarly to trained Ss, but were slower and more variable. Accuracy of recall on a music dictation task also favored 4/4 meter rather than matched rhythms. Coding of pitch content may have been facilitated by the structural framework of 4/4 meter rather than by expectancies arising from the match of temporal and pitch organization.     

A bidimensional model of pitch in the recognition of melodies

Pitch can be conceptualized as a bidimensional quantity, reflecting both the overall pitch level of a tone (tone height) and its position in the octave (tone chroma). Though such a conceptualization has been well supported for perception of a single tone, it has been argued that the dimension of tone chroma is irrelevant in melodic perception. In the current study, melodies were subjected to structural transformations designed to evaluate the effects of interval magnitude, contour, tone height, and tone chroma. In two transformations, the component tones of a melody were displaced by octave intervals, either preserving or violating the pattern of changes in pitch direction (melodic contour). Replicating previous work, when contour was violated perception of the melody was severely disrupted. In contrast, when contour was preserved the melodies were identified as accurately as the untransformed melodies. In other transformations, a variety of forms of contour information were preserved, while eliminating information for absolute pitch and interval magnitude. The level of performance on all such transformations fell between the levels observed in the other two conditions. These results suggest that the bidimensional model of pitch is applicable to recognition of melodies as well as single tones. Moreover, the results argue that contour, as well as interval magnitude, is providing essential information for melodic perception.     

The effects of age on the strategic use of pitch accents in memory for discourse: a processing-resource account

In two experiments, we investigated age-related changes in how prosodic pitch accents affect memory. Participants listened to recorded discourses that contained two contrasts between pairs of items (e.g., one story contrasted British scientists with French scientists and Malaysia with Indonesia). The end of each discourse referred to one item from each pair; these references received a pitch accent that either denoted contrast (L + H* in the ToBI system) or did not (H*). A contrastive accent on a particular pair improved later recognition memory equally for young and older adults. However, older adults showed decreased memory if the other pair received a contrastive accent (Experiment 1). Young adults with low working memory performance also showed this penalty (Experiment 2). These results suggest that pitch accents guide processing resources to important information for both older and younger adults but diminish memory for less important information in groups with reduced resources, including older adults.     

Infants use meter to categorize rhythms and melodies: implications for musical structure learning

Little is known about whether infants perceive meter, the underlying temporal structure of music. We employed a habituation paradigm to examine whether 7-month-old infants could categorize rhythmic and melodic patterns on the basis of the underlying meter, which was implied from event and accent frequency of occurrence. In Experiment 1, infants discriminated duple and triple classes of rhythm on the basis of implied meter. Experiment 2 replicated this result while controlling for rhythmic grouping structure, confirming that infants perceived metrical structure despite occasional ambiguities and conflicting group structure. In Experiment 3, infants categorized melodies on the basis of contingencies between metrical position and pitch. Infants presented with metrical melodies detected reversals of pitch/meter contingencies, while infants presented with non-metrical melodies showed no preference. Results indicate that infants can infer meter from rhythmic patterns, and that they may use this metrical structure to bootstrap their knowledge acquisition in music learning.     

Some effects of rhythmic context on melody recognition

The effects of rhythmic context on the ability of listeners to recognize slightly altered versions of 10-tone melodies were examined in three experiments. Listeners judged the melodic equivalence of two auditory patterns when their rhythms were either the same or different. Rhythmic variations produced large effects on a bias measure, indicating that listeners judged melodies to be alike if their rhythms were identical. However, neither rhythm nor pattern rate affected discriminability measures in the first study, in which rhythm was treated as a within subjects variable. The other two studies examined rhythmic context as a between subjects variable. In these, significant effects of temporal uncertainty due to the number and type of rhythms involved in a block of trials, as well as their assignment to standard and comparison melodies on a given trial, were apparent on both discriminability and bias measures. Results were interpreted in terms of the effect of temporal context on the rhythmic targeting of attention.     

Exposure effects on music preference and recognition

In three experiments, the effects of exposure to melodies on their subsequent liking and recognition were explored. In each experiment, the subjects first listened to a set of familiar and unfamiliar melodies in a study phase. In the subsequent test phase, the melodies were repeated, along with a set of distractors matched in familiarity. Half the subjects were required to rate their liking of each melody, and half had to identify the melodies they had heard earlier in the study phase. Repetition of the studied melodies was found to increase liking of the unfamiliar melodies in the affect task and to be best for detection of familiar melodies in the recognition task (Experiments 1, 2, and 3). These memory effects were found to fade at different time delays between study and test in the affect and recognition tasks, with the latter leading to the most persistent effects (Experiment 2). Both study-to-test changes in melody timbre and manipulation of study tasks had a marked impact on recognition and little influence on liking judgments (Experiment 3). Thus, all manipulated variables were found to dissociate the memory effects in the two tasks. The results are consistent with the view that memory effects in the affect and recognition tasks pertain to the implicit and explicit forms of memory, respectively. Part of the results are, however, at variance with the literature on implicit and explicit memory in the auditory domain. Attribution of these differences to the use of musical material is discussed.     

The abstraction of musical ideas

Music presents information both sequentially, in the form of musical phrases, and simultaneously, in the form of chord structure. The ability to abstract musical structure presented sequentially and simultaneously was investigated using modified versions of the Bransford and Franks’ (1971) paradigm. Listeners heard subsets of musical ideas. The abstraction hypothesis predicted (1) false recognition of novel instances of the abstracted musical idea, (2) confidence of “recognition” should increase as recognition items approximate the complete musical idea, (3) correct rejection of “noncases,” which deviate from the acquired musical structure. Experiment 1 investigated sequential abstraction by using four-phrase folk melodies as musical ideas. Predictions 1 and 3 were confirmed, but the false recognition rate decreased as the number of phrases increased. Listeners were sensitive to improper combinations of phrases and to novel melodies different from melodies presented during acquisition. Experiment 2 investigated simultaneous abstraction using four-voice Bach chorales as musical ideas. Listeners spontaneously integrated choral subsets into holistic musical ideas. Musically trained listeners were better than naive listeners at identifying noncases.     

The role of knowledge-based expectations in music perception: evidence from musical restoration

The perceptual restoration of musical sounds was investigated in 5 experiments with Samuel's (1981a) discrimination methodology. Restoration in familiar melodies was compared to phonemic restoration in Experiment 1. In the remaining experiments, we examined the effect of expectations (generated by familiarity, predictability, and musical schemata) on musical restoration. We investigated restoration in melodies by comparing familiar and unfamiliar melodies (Experiment 2), as well as unfamiliar melodies varying in tonal and rhythmic predictability (Experiment 3). Expectations based on both familiarity and predictability were found to reduce restoration at the melodic level. Restoration at the submelodic level was investigated with scales and chords in Experiments 4 and 5. At this level, key-based expectations were found to increase restoration. Implications for music perception, as well as similarities between restoration in music and speech, are discussed.