Some influences of accent structure on melody recognition

Two experiments were carried out to investigate the roles of joint accent structure and familiarity in delayed recognition of relatively long tonal melodies. Melodic themes of target melodies were defined by correlating contour-related pitch accents with temporal accents (accent coupling) during an initial familiarization phase. Later, subjects gave recognition responses to key-transposed versions of the target melodies as well as to decoys with same and different contour accent patterns. In Experiment 1, all to-be-recognized melodies occurred both in an original rhythm, which preserved accent coupling, and in a new rhythm, which did not. Listeners were best at distinguishing targets from different decoys, especially in the original rhythm. In Experiment 2, the familiarity of target tunes and the rhythmic similarity in recognition were varied. Similar rhythms preserved accent coupling, whereas dissimilar rhythms did not. Listeners were most adept in distinguishing familiar targets from different decoys (Experiment 2A), particularly when they appeared in novel but similar rhythms. However, in similar rhythm conditions, listeners also frequently mistook same decoys for targets. With less familiar targets (Experiment 2B), these effects were attenuated, and performance showed general effects of pitch contour.     

Learning harmony: the role of serial statistics

How do listeners learn about the statistical regularities underlying musical harmony? In traditional Western music, certain chords predict the occurrence of other chords: Given a particular chord, not all chords are equally likely to follow. In Experiments 1 and 2, we investigated whether adults make use of statistical information when learning new musical structures. Listeners were exposed to a novel musical system containing phrases generated using an artificial grammar. This new system contained statistical structure quite different from Western tonal music. Our results suggest that learners take advantage of the statistical patterning of chords to acquire new musical structures, similar to learning processes previously observed for language learning.     

Memory for surface features of unfamiliar melodies: independent effects of changes in pitch and tempo

A melody’s identity is determined by relations between consecutive tones in terms of pitch and duration, whereas surface features (i.e., pitch level or key, tempo, and timbre) are irrelevant. Although surface features of highly familiar recordings are encoded into memory, little is known about listeners’ mental representations of melodies heard once or twice. It is also unknown whether musical pitch is represented additively or interactively with temporal information. In two experiments, listeners heard unfamiliar melodies twice in an initial exposure phase. In a subsequent test phase, they heard the same (old) melodies interspersed with new melodies. Some of the old melodies were shifted in key, tempo, or key and tempo. Listeners’ task was to rate how well they recognized each melody from the exposure phase while ignoring changes in key and tempo. Recognition ratings were higher for old melodies that stayed the same compared to those that were shifted in key or tempo, and detrimental effects of key and tempo changes were additive in between-subjects (Experiment 1) and within-subjects (Experiment 2) designs. The results confirm that surface features are remembered for melodies heard only twice. They also imply that key and tempo are processed and stored independently.     

Maximum key-profile correlation (MKC) as a measure of tonal structure in music

Tonal structure is musical organization on the basis of pitch, in which pitches vary in importance and rate of occurrence according to their relationship to a tonal center. Experiment 1 evaluated the maximum key-profile correlation (MKC), a product of Krumhansl and Schmuckler’s key-finding algorithm (Krumhansl, 1990), as a measure of tonal structure. The MKC is the maximum correlation coefficient between the pitch class distribution in a musical sample and key profiles,which indicate the stability of pitches with respect to particular tonal centers. The MKC values of melodies correlated strongly with listeners’ ratings of tonal structure. To measure the influence of the temporal order of pitches on perceived tonal structure, three measures (fifth span, semitone span, and pitch contour) taken from previous studies of melody perception were also correlated with tonal structure ratings. None of the temporal measures correlated as strongly or as consistently with tonal structure ratings as did the MKC, and nor did combining them with the MKC improve prediction of tonal structure ratings. In Experiment 2, the MKC did not correlate with recognition memory of melodies. However, melodies with very low MKC values were recognized less accurately than melodies with very high MKC values. Although it does not incorporate temporal, rhythmic, or harmonic factors that may influence perceived tonal structure, the MKC can be interpreted as a measure of tonal structure, at least for brief melodies.     

Recognizing melodies: A dynamic interpretation

Two experiments explore hypotheses about rhythm and contour in recognition of simple pitch strings (melodies). Target melodies that differed with respect to pitch relationships (interval and contour pitch differences) and rhythm, were presented to ordinary listeners who were told to learn the melodies (Phase I). In a subsequent recognition test (Phase II), listeners had to recognize these same target melodies although they were transposed to a different musical key. In recognition, target melodies appeared in the original rhythm or in new rhythms that simulated some pause properties of the original rhythm. Target melodies were interspersed with decoy melodies that either preserved the pitch contour of targets or did not; all appeared in the original rhythm and in new rhythms. Results indicated that a new rhythmic context lowered recognizability of target melodies, and that decoys were most confusing when they possessed the same “dynamic shape” (contour-plus-rhythm) as targets (Experiment 1). Also, target recognition improved with Phase I familiarity (Experiment 2), although rhythmic shifts remained detrimental across levels of target familiarity. Confusions based on “dynamic shape” accounted for a relatively high proportion of errors where familiarity with targets is low. Findings were interpreted in terms of a theory of context-sensitive dynamic attending in which remembering is assumed to involve recapitulation of the original rhythmical activities involved in attending to melodies.     

Phrasing influences the recognition of melodies

One critical step in the processing of complex auditory information (i.e., language and music) involves organizing such information into hierarchical units, such as phrases. In this study, musically trained and untrained listeners' recognition memory for short, naturalistic melodies varying in their phrase structure was tested. For musically trained subjects, memory for information preceding a phrase boundary was disrupted and memory for information subsequent to a phrase boundary was enhanced relative to memory in similar temporal locations for excerpts not containing a phrase boundary. Musically untrained listeners, in contrast, showed no such differences as a function of the phrasing of the melody. These findings conform with previous results in both psycholinguistics and musical cognition and suggest that the phrase serves as a functional unit in musical processing, guiding the parsing of musical sequences during perception, along with the structuring of memory for musical passages.     

Recognition of notated melodies by possessors and nonpossessors of absolute pitch

Musically trained listeners compared a notated melody presented visually and a comparison melody presented auditorily, and judged whether they were exactly the same or not, with respect to relative pitch. Listeners who had absolute pitch showed the poorest performance for melodies transposed to different pitch levels from the notated melodies, whereas they exhibited the highest performance for untransposed melodies. By comparison, the performance of melody recognition by listeners who did not have absolute pitch was not influenced by the actual pitch level at which melodies were played. These results suggest that absolute-pitch listeners tend to rely on absolute pitch even in recognizing transposed melodies, for which the absolute-pitch strategy is not useful.     

Recognition of notated melodies by possessors and nonpossessors of absolute pitch

Musically trained listeners compared a notated melody presented visually and a comparison melody presented auditorily, and judged whether they were exactly the same or not, with respect to relative pitch. Listeners who had absolute pitch showed the poorest performance for melodies transposed to different pitch levels from the notated melodies, whereas they exhibited the highest performance for untransposed melodies. By comparison, the performance of melody recognition by listeners who did not have absolute pitch was not influenced by the actual pitch level at which melodies were played. These results suggest that absolute-pitch listeners tend to rely on absolute pitch even in recognizing transposed melodies, for which the absolute-pitch strategy is not useful.     

Name or hum that tune: Feeling of knowing for music

This is the first reported research that explores the feeling of knowing (FOK) for musical stimuli. Subjects attempted to recall melodies and titles of musical pieces, made FOK ratings when recall failed, and then had a recognition test. With instrumental music (Experiment 1), more titles were recalled when melodies were given as cues than vice versa. With songs whose lyrics were not presented (Experiment 2), however, more melodies were recalled than were titles. For nonrecalled items, although the overall levels of recognition did not differ, FOK ratings were higher for titles than for melodies in Experiment 1, and the opposite pattern occurred in Experiment 2. In both experiments, the FOK ratings predicted melody recognition more accurately than they did title recognition.     

Specific previous experience affects perception of harmony and meter

Prior knowledge shapes our experiences, but which prior knowledge shapes which experiences? This question is addressed in the domain of music perception. Three experiments were used to determine whether listeners activate specific musical memories during music listening. Each experiment provided listeners with one of two musical contexts that was presented simultaneously with a melody. After a listener was familiarized with melodies embedded in contexts, the listener heard melodies in isolation and judged the fit of a final harmonic or metrical probe event. The probe event matched either the familiar (but absent) context or an unfamiliar context. For both harmonic (Experiments 1 and 3) and metrical (Experiment 2) information, exposure to context shifted listeners' preferences toward a probe matching the context that they had been familiarized with. This suggests that listeners rapidly form specific musical memories without explicit instruction, which are then activated during music listening. These data pose an interesting challenge for models of music perception which implicitly assume that the listener's knowledge base is predominantly schematic or abstract.     

Emotional response to musical repetition

Two experiments examined the effects of repetition on listeners' emotional response to music. Listeners heard recordings of orchestral music that contained a large section repeated twice. The music had a symmetric phrase structure (same-length phrases) in Experiment 1 and an asymmetric phrase structure (different-length phrases) in Experiment 2, hypothesized to alter the predictability of sensitivity to musical repetition. Continuous measures of arousal and valence were compared across music that contained identical repetition, variation (related), or contrasting (unrelated) structure. Listeners' emotional arousal ratings differed most for contrasting music, moderately for variations, and least for repeating musical segments. A computational model for the detection of repeated musical segments was applied to the listeners' emotional responses. The model detected the locations of phrase boundaries from the emotional responses better than from performed tempo or physical intensity in both experiments. These findings indicate the importance of repetition in listeners' emotional response to music and in the perceptual segmentation of musical structure.     

Early use of phonetic information in spoken word recognition: Lexical stress drives eye movements immediately

For optimal word recognition listeners should use all relevant acoustic information as soon as it comes available. Using printed-word eye tracking we investigated when during word processing Dutch listeners use suprasegmental lexical stress information to recognize words. Fixations on targets such as “OCtopus” (capitals indicate stress) were more frequent than fixations on segmentally overlapping but differently stressed competitors (“okTOber”) before segmental information could disambiguate the words. Furthermore, prior to segmental disambiguation, initially stressed words were stronger lexical competitors than noninitially stressed words. Listeners recognize words by immediately using all relevant information in the speech signal.     

Expected endings and judged duration

In four experiments, the predictions of an expectancy/contrast model (Jones & Boltz, 1989) for judged duration were evaluated. In Experiments 1 and 2, listeners estimated the relative durations of auditory pattern pairs that varied in contextual phrasing and temporal contrast. The results showed that when the second pattern of a pair either seems to (Experiments 1 and 2) or actually does (Experiment 2) end earlier (later)than the first, subjects judge it as being relatively shorter (longer). In Experiment 3, listeners heard single patterns in which notes immediately preceding the final one were omitted. Timing of the final (target) tone was varied such that it was one beat early, on time, or one beat late. Listeners’ ratings of target tones revealed systematic effects of phrasing and target timing. In Experiment 4, listeners temporally completed (extrapolated) sequences of Experiment 3 that were modified to exclude the target tone. The results again showed that phrase context systematically influenced expectancies about “when” sequences should end. As a set, these studies demonstrate the effects of event structure and anticipatory attending upon experienced duration and are discussed in terms of the expectancy/contrast model.     

Effects of uncertainty on melodic information processing

In three experiments, musically trained and untrained adults listened to three repetitions of a 5-note melodic sequence followed by a final melody with either the same tune as those preceding it or differing in one position by one semitone. In Experiment 1, ability to recognize the final sequence was examined as a function of redundancy at the levels of musical structure in a sequence, contour complexity of transpositions in a trial, and trial context in a session. Within a sequence, tones were related as the major or augmented triad; within a trial, the four sequences began on successively higher notes (simple macrocontour) or on randomly selected notes (complex macrocontour); and within a session, trials were either blocked (all major or all augmented) or mixed (major and augmented randomly selected). Performance was superior for major melodies, for systematic transpositions within a trial (simple macrocontours), for blocked trials, and for musically trained listeners. In Experiment 2, we examined further the effect of macrocontour. Performance on simple macrocontours exceeded that on complex, and excluded the possibility that repetition of the 20-note sequences provided the entire benefit of systematic transposition in Experiment 1. The effect of musical structure (major/augmented) was also replicated. In Experiment 3, listeners provided structure ratings of ascending 20-note sequences from Experiment 2. Ratings on same trials were higher than those on corresponding different trials, in contrast to performance scores for augmented same and different trials in previous experiments. The concept of functional uncertainty was proposed to account for recognition difficulties on augmented same trials. The significant effects of redundancy on all the levels examined confirm the utility of the information-processing framework for the study of melodic sequence perception.     

Expectancy in melody: tests of children and adults

Melodic expectancies among children and adults were examined. In Experiment 1, adults, 11-year-olds, and 8-year-olds rated how well individual test tones continued fragments of melodies. In Experiment 2, 11-, 8-, and 5-year-olds sang continuations to 2-tone stimuli. Response patterns were analyzed using 2 models of melodic expectancy. Despite having fewer predictor variables, the 2-factor model (E. G. Schellenberg, 1997) equaled or surpassed the implication-realization model (E. Narmour, 1990) in predictive accuracy. Listeners of all ages expected the next tone in a melody to be proximate in pitch to the tone heard most recently. Older listeners also expected reversals of pitch direction, specifically for tones that changed direction after a disruption of proximity and for tones that formed symmetric patterns.     

A perceptual investigation of polytonality

Summary Four experiments investigated the perception of tonal structure in polytonal music. The experiments used musical excerpts in which the upper stave of the music suggested a different key than the lower stave. In Experiment 1, listeners rated the goodness of fit of probe tones following an excerpt from Dubois's Circus. Results suggested that listeners were sensitive to two keys, and weighted them according to their perceived importance within the excerpt. Experiment 2 confirmed that music within each stave reliably conveyed key structure on its own. In Experiment 3, listeners rated probe tones following an excerpt from Milhaud's Sonata No. 1 for Piano, in which different keys were conveyed in widely separate pitch registers. Ratings were collected across three octaves. Listeners did not associate each key with a specific register. Rather, ratings for all three octave registers reflected only the key associated with the upper stave. Experiment 4 confirmed that the music within each stave reliably conveyed key structure on its own. It is suggested that when one key predominates in a polytonal context, other keys may not contribute to the overall perceived tonal structure. The influence of long-term knowledge and immediate context on the perception of tonal structure in polytonal music is discussed.     

Expectancies generated by recent exposure to melodic sequences

In four experiments, we examined the effects of exposure to unfamiliar tone sequences on melodic expectancy and memory. In Experiment 1, 30 unfamiliar tone sequences (target sequences) were presented to listeners three times each in random order (exposure phase), and listeners recorded the number of notes in each sequence. Listeners were then presented target and novel sequences and rated how well the final note continued the pattern of notes that preceded it. Novel sequences were identical to target sequences, except for the final note. Ratings were significantly higher for target sequences than for novel sequences, illustrating the influence of exposure on melodic expectancy. Experiment 2 confirmed that without exposure to target sequences, ratings were equivalent for target and novel sequences. In Experiment 3, new listeners were assessed for explicit memory for target sequences following the exposure phase. Recognition of target sequences was above chance, but unrelated to expectancy judgments in Experiment 1. Experiment 4 replicated the exposure effect, using a modified experiment design, and confirmed that the effect is not dependent on explicit memory for sequences. We discuss the idea that melodic expectancies are influenced by implicit memory for recently heard melodic patterns.     

Effects of uncertainty on melodic

In three experiments, musically trained and untrained adults listened to three repetitions of a 5-note melodic sequence followed by a final melody with either the same tune as those preceding it or differing in one position by one semitone. In Experiment 1, ability to recognize the final sequence was examined as a function of redundancy at the levels of musical structurein a sequence, contour complexity of transpositions in a trial, and trial context in a session. Within a sequence, tones were related as the major or augmented triad; within a trial, the four sequences began on successively higher notes (simple macrocontour) or on randomly selected notes (complex macrocontour); and within a session, trials were either blocked (all major or all augmented) or mixed (major and augmented randomly selected). Performance was superior for major melodies, for systematic transpositions within a trial (simple macrocontours), for blocked trials, and for musically trained listeners. In Experiment 2, we examined further the effect of macrocontour. Performance on simple macrocontours exceeded that on complex, and excluded the possibility that repetition of the 20-note sequences provided the entire benefit of systematic transposition in Experiment 1. The effect of musical structure (major/augmented) was also replicated. In Experiment 3, listeners provided structure ratings of ascending 20-note sequences fromExperiment 2. Ratings onsame trials were higher than those on correspondingdifferent trials, in contrast to performance scores for augmentedsame anddifferent trials in previous experiments. The concept of functional uncertainty was proposed to account for recognition difficulties on augmented same trials. The significant effects of redundancy on all the levels examined confirm the utility of the information-processing framework for thestudy of melodic sequence perception.     

Change deafness across voices in music and language

ABSTRACT

Listeners made same/different evaluations of a pair of musical presentations separated by a broadband noise. In the first experiment, the pair had either the same or a different: singers voice, language (Spanish or English), and reverberation (dry or very high reverb). A second experiment was conducted using the same vocal melodies played on guitars to emphasize non-linguistic content. In both Experiments 1 and 2, large-scale changes to Reverb were either completely undetected or ignored. A change of language in Experiment 1 supported only minimal sensitivity to change detection. Changes to multiple variables tended to increase listener sensitivity to a stimulus change. The results seem to indicate that the semantic coherence created by a musical background may limit attention to linguistic changes and voicing. Rather, those changes that more directly influence musical quality may be of greater salience in a musical context.     

False memories for compound words: Role of working memory

Subjects studied pairs of compound words; pair members were presented simultaneously (one above the other) for 2 sec or sequentially (one immediately following the other) for 1 sec each, and 6-sec interstimulus intervals separated the end of presentation of one pair and the start of that of another. A subsequent recognition test included within-pair and between-pair conjunction foils (recombinations of stimulus parts from the same study pair and from separate pairs, respectively). Previous experiments using faces as stimuli have demonstrated that when faces are presented simultaneously there are many more false alarms to within-pair than to between-pair conjunction items, and when faces are presented sequentially there is an equal number of false alarms in those two conditions. However, Experiment 1 showed that for compound word stimuli there were equally high false alarm rates toboth types of foils in both study conditions relative to completely new test items. Experiment 2 showed that when rehearsal of compound words was prevented, the pattern of conjunction errors was very similar to the one typically obtained for faces. In Experiment 3, subjects falsely recalled conjunctions of within-pair compound words but not conjunctions of between-pair words in the simultaneous-study condition; no conjunctions were recalled in the sequential-study condition. The results support the idea that working memory processing is necessary for binding stimulus parts together in episodic memory.