Maximum key-profile correlation (MKC) as a measure of tonal structure in music

Tonal structure is musical organization on the basis of pitch, in which pitches vary in importance and rate of occurrence according to their relationship to a tonal center. Experiment 1 evaluated the maximum key-profile correlation (MKC), a product of Krumhansl and Schmuckler’s key-finding algorithm (Krumhansl, 1990), as a measure of tonal structure. The MKC is the maximum correlation coefficient between the pitch class distribution in a musical sample and key profiles,which indicate the stability of pitches with respect to particular tonal centers. The MKC values of melodies correlated strongly with listeners’ ratings of tonal structure. To measure the influence of the temporal order of pitches on perceived tonal structure, three measures (fifth span, semitone span, and pitch contour) taken from previous studies of melody perception were also correlated with tonal structure ratings. None of the temporal measures correlated as strongly or as consistently with tonal structure ratings as did the MKC, and nor did combining them with the MKC improve prediction of tonal structure ratings. In Experiment 2, the MKC did not correlate with recognition memory of melodies. However, melodies with very low MKC values were recognized less accurately than melodies with very high MKC values. Although it does not incorporate temporal, rhythmic, or harmonic factors that may influence perceived tonal structure, the MKC can be interpreted as a measure of tonal structure, at least for brief melodies.     

The psychological representation of musical pitch in a tonal context

In this series of experiments, evidence was found for a complex psychological representation of musical pitch. The results of a scaling study, in which subjects judged the similarities between pairs of tones presented in an explicitly tonal context, suggest that musical listeners extract a pattern of relationships among tones that is determined not only by pitch height and chroma, but also by membership in the major triad chord and the diatonic scale associated with the tonal system of the context. Multidimensional scaling of the similarity ratings gave a three-dimensional conical structure around which the tones were ordered according to pitch height. The major triad components formed a closely related cluster near the vertex of the cone; the remaining diatonic scale tones formed a less closely related subset farther from the vertex; and, the nondiatonic tones, still farther from the vertex, were widely dispersed. The results also suggest that, in the psychological representation, tones less closely related to the tonality are less stable than tones closely related to the tonality, and that the representation incorporates the tendency for unstable tones to move toward the more stable tones in time, reflecting the dynamic character of musical tones. In the similarity ratings of the scaling study, tones less related to the tonality were judged more similar to tones more related to the tonality than the reverse temporal order. Furthermore, in a delayed recognition task memory performance for nondiatonic tones was less accurate than for diatonic tones, and nondiatonic tones were more often confused with diatonic tones than diatonic tones were confused with nondiatonic tones. These results indicate the tonality-specific nature of the psychological representation and argue that the perception of music depends not only on psychoacoustic properties of the tones, but also on processes that relate the tones to one another through contact with a well-defined and complex psychological representation of musical pitch.     

Tonal hierarchy representations in auditory imagery

Two experiments investigated psychological representations of musical tonality in auditory imagery. In Experiment 1, musically trained participants heard a single tone as a perceptual cue and built an auditory image of a specified major tonality based on that cue; participants’ images were then assessed using judgments of probe tones. In Experiment 2 participants imaged a minor tonality rather than a major one. Analysis of the probe tone ratings indicated that participants successfully imaged both major and minor tonal hierarchies, demonstrating that auditory imagery functions comparably to auditory perception. In addition, the strength of the major tonal image was dependent upon the pitch and tonal relations of the perceptual cue and the to-be-imaged tonality. Finally, representations of minor tonal hierarchies were less robust than those of major ones, converging with perceptual evidence that minor tonalities are less psychologically stable than major tonalities.     

绝对音高感对音乐句法加工能力的影响

绝对音高感是一种敏锐的音高知觉能力。拥有这种能力的人可以在没有标准音(A4)参照下, 对所听到的音高进行命名。本文通过对比绝对音高感被试与不具有绝对音高感被试对音乐句法基本规则的知觉以及对音乐句法结构划分能力的差异, 探讨绝对音高感与音乐句法加工能力之间的关系。结果表明, 绝对音高感被试对音乐句法基本规则的知觉水平高于控制组; 同时, 这种知觉上的优势也延伸到他们对音乐句法结构的划分。这一结果说明, 绝对音高感被试不仅可以对音高进行孤立命名, 而且表现出对调性音乐音高关系加工的优势。     

Some structural determinants of melody recall

Sophisticated musicians were asked to recall, using musical notation, a set of unfamiliar folk tunes that varied in rhythmic structure and referents of tonality. The results showed that memory was facilitated by tonic triad members marking phrase endings, but only when their presence was highlighted by a corresponding pattern of temporal accents. Conversely, recall significantly declined when tonal information was either absent or obscured by rhythmic structure. Error analyses further revealed that the retention of overall pitch contour and information at phrase ending points varied as a function of these manipulations. The results are discussed in terms of a framework that links the acts of perceiving and remembering to a common attentional scheme.     

Tonal strength and melody recognition after long and short delays

In a continuous-running-memory task, subjects heard novel seven-note melodies that were tested after delays of 11 sec (empty) or 39 sec (filled). Test items were transposed to new pitch levels (to moderately distant keys in the musical sense)and included exact transpositions (targets), same-contour lures with altered pitch intervals, and new-contour lures. Melodies differed in tonal strength (degree of conformity to a musical key) and were tonally strong, tonally weak, or atonal. False alarms to same-contour lures decreased over the longer delay period, but only for tonal stimuli. In agreement with previous studies, discrimination of detailed changes in pitch intervals improved with increased delay, whereas discrimination of more global contour information declined, again only for tonal stimuli. These results suggest that poor short-delay performance in rejecting same-contour lures arises from confusion that is based on the similarity of tonality between standard stimuli and lures. If a test item has the same contour and a similar tonality to a just-presented item, subjects tend to accept it. After a delay filled with melodies in other tonalities, the salience of key information recedes, and subjects base their judgments on more detailed pattern information (namely, exact pitch intervals). The fact that tonality affects judgments of melodic contour indicates that contour is not an entirely separable feature of melodies but rather that a melody with its contour constitutes an integrated perceptual whole.     

Tonal strength and melody recognition after long and short delays.

In a continuous-running-memory task, subjects heard novel seven-note melodies that were tested after delays of 11 sec (empty) or 39 sec (filled). Test items were transposed to new pitch levels (to moderately distant keys in the musical sense) and included exact transpositions (targets), same-contour lures with altered pitch intervals, and new-contour lures. Melodies differed in tonal strength (degree of conformity to a musical key) and were tonally strong, tonally weak, or atonal. False alarms to same-contour lures decreased over the longer delay period, but only for tonal stimuli. In agreement with previous studies, discrimination of detailed changes in pitch intervals improved with increased delay, whereas discrimination of more global contour information declined, again only for tonal stimuli. These results suggest that poor short-delay performance in rejecting same-contour lures arises from confusion that is based on the similarity of tonality between standard stimuli and lures. If a test item has the same contour and a similar tonality to a just-presented item, subjects tend to accept it. After a delay filled with melodies in other tonalities, the salience of key information recedes, and subjects base their judgments on more detailed pattern information (namely, exact pitch intervals). The fact that tonality affects judgments of melodic contour indicates that contour is not an entirely separable feature of melodies but rather that a melody with its contour constitutes an integrated perceptual whole.     

Perceptual interactions between musical pitch and timbre.

These experiments examined perceptual interactions between musical pitch and timbre. Experiment 1, through the use of the Garner classification tasks, found that pitch and timbre of isolated tones interact. Classification times showed interference from uncorrelated variation in the irrelevant attribute and facilitation from correlated variation; the effects were symmetrical. Experiments 2 and 3 examined how musical pitch and timbre function in longer sequences. In recognition memory tasks, a target tone always appeared in a fixed position in the sequences, and listeners were instructed to attend to either its pitch or its timbre. For successive tones, no interactions between timbre and pitch were found. That is, changing the pitches of context tones did not affect timbre recognition, and vice versa. The tendency to perceive pitch in relation to other context pitches was strong and unaffected by whether timbre was constant or varying. In contrast, the relative perception of timbre was weak and was found only when pitch was constant. These results suggest that timbre is perceived more in absolute than in relative terms. Perceptual implications for creating patterns in music with timbre variations are discussed.     

Perceptual tests of an algorithm for musical key-finding

Perceiving the tonality of a musical passage is a fundamental aspect of the experience of hearing music. Models for determining tonality have thus occupied a central place in music cognition research. Three experiments investigated 1 well-known model of tonal determination: the Krumhansl-Schmuckler key-finding algorithm. In Experiment 1, listeners' percepts of tonality following short musical fragments derived from preludes by Bach and Chopin were compared with predictions of tonality produced by the algorithm; these predictions were very accurate for the Bach preludes but considerably less so for the Chopin preludes. Experiment 2 explored a subset of the Chopin preludes, finding that the algorithm could predict tonal percepts on a measure-by-measure basis. In Experiment 3, the algorithm predicted listeners' percepts of tonal movement throughout a complete Chopin prelude. These studies support the viability of the Krumhansl-Schmuckler key-finding algorithm as well as a model of listeners' tonal perceptions of musical passages.     

The integration of stimulus dimensions in the perception of music

A central aim of cognitive psychology is to explain how we integrate stimulus dimensions into a unified percept, but how the dimensions of pitch and time combine in the perception of music remains a largely unresolved issue. The goal of this study was to test the effect of varying the degree of conformity to dimensional structure in pitch and time (specifically, tonality and metre) on goodness ratings and classifications of melodies. The pitches and durations of melodies were either presented in their original order, as a reordered sequence, or replaced with random elements. Musically trained and untrained participants (24 each) rated melodic goodness, attending selectively to the dimensions of pitch, time, or both. Also, 24 trained participants classified whether or not the melodies were tonal, metric, or both. Pitch and temporal manipulations always influenced responses, but participants successfully emphasized either dimension in accordance with instructions. Effects of pitch and time were mostly independent for selective attention conditions, but more interactive when evaluating both dimensions. When interactions occurred, the effect of either dimension increased as the other dimension conformed more to its original structure. Relative main effect sizes (| pitch η(2) - time η(2) |) predicted the strength of pitch-time interactions (pitch?×?time η(2)); interactions were stronger when main effect sizes were more evenly matched. These results have implications for dimensional integration in several domains. Relative main effect size could serve as an indicator of dimensional salience, such that interactions are more likely when dimensions are equally salient.     

Perceiving the end: effects of tonal relationships on melodic completion

Two experiments examined listeners' sensitivity to the structural markers of melodic completion. In Experiment 1, both musicians and nonmusicians were asked to rate the ending of folk melodies for their degree of "completeness" and "tonal appropriateness." Results showed that melodies ending with the conventional leading tone-to-tonic progression were rated the most complete and tonally appropriate to the underlying key, more so than melodies ending with the submediant-to-tonic or the tonic-to-dominant progressions. Conversely, melodies ending on the leading tone seemed the most incomplete and tonally inappropriate. In Experiment 2, the perceptual salience of certain pitch functions was enhanced significantly by the pattern of rhythmic accentuation within a melody's context and the presence of the rare tritone interval. The results illustrate an interactive influence of pitch and temporal variables on musical perception and thereby highlight the need to incorporate dynamic pattern factors into internal representations of tonality.     

Absolute pitch in infancy and adulthood: the role of tonal structure

Despite many similarities in infant and adult auditory processing, the literature suggests that two aspects of music perception, pitch processing and knowledge of tonal structure, change over development. The current experiments assess the use of absolute and relative pitch cues in a tone sequence statistical learning task containing tonal structure. The results suggest that infants preferentially process absolute pitch patterns in continuous tone sequences, supporting the hypothesis that absolute pitch is present in infancy, whereas adults tracked both absolute and relative pitch patterns. Infants and adults detected the tonal structure in the input, suggesting that humans are attuned to basic aspects of tonality early in life.     

Music perception and octave generalization in rhesus monkeys

Two rhesus monkeys were tested for octave generalization in 8 experiments by transposing 6- and 7-note musical passages by an octave and requiring same or different judgments. The monkeys showed no octave generalization to random-synthetic melodies, atonal melodies, or individual notes. They did show complete octave generalization to childhood songs (e.g., "Happy Birthday") and tonal melodies (from a tonality algorithm). Octave generalization was equally strong for 2-octave transpositions but not for 0.5- or 1.5-octave transpositions of childhood songs. These results combine to show that tonal melodies form musical gestalts for monkeys, as they do for humans, and retain their identity when transposed with whole octaves so that chroma (key) is preserved. This conclusion implicates similar transduction, storage, processing, and relational memory of musical passages in monkeys and humans and has implications for nature-nurture origins of music perception.     

Dynamic processes in music perception

A schema-based theory of music perception that describes the dynamic interaction between the musical event and the listener’s knowledge of the underlying regularities in tonal music is proposed. Three properties of musical schema are evaluated in a recognition memory experiment: (1) The schema engages a subset of the abstract knowledge system that is determined by the predominant key of the musical sequence, (2) the schema evaluates both interval relations and the functions of the sounded elements within the established tonal framework, and (3) the schema interacts continuously with the musical event in time to process pitch information in its temporal context. Listeners are required to identify the serial position of a chord that is changed between two successive chord sequences that are otherwise identical. The experiment measures the magnitude and the temporal extent of the disruptive effect of including in the sequence an element outside the tonal framework. The results show temporally specific effects on memory for pitch relations consistent with the operation of a musical schema. Comparisons are made with schema-based theories applied in other perceptual and cognitive domains.     

Differential recognition of pitch patterns in discrete and gliding stimuli in congenital amusia: evidence from Mandarin speakers

This study examined whether "melodic contour deafness" (insensitivity to the direction of pitch movement) in congenital amusia is associated with specific types of pitch patterns (discrete versus gliding pitches) or stimulus types (speech syllables versus complex tones). Thresholds for identification of pitch direction were obtained using discrete or gliding pitches in the syllable /ma/ or its complex tone analog, from nineteen amusics and nineteen controls, all healthy university students with Mandarin Chinese as their native language. Amusics, unlike controls, had more difficulty recognizing pitch direction in discrete than in gliding pitches, for both speech and non-speech stimuli. Also, amusic thresholds were not significantly affected by stimulus types (speech versus non-speech), whereas controls showed lower thresholds for tones than for speech. These findings help explain why amusics have greater difficulty with discrete musical pitch perception than with speech perception, in which continuously changing pitch movements are prevalent.     

The integration of stimulus dimensions in the perception of music

A central aim of cognitive psychology is to explain how we integrate stimulus dimensions into a unified percept, but how the dimensions of pitch and time combine in the perception of music remains a largely unresolved issue. The goal of this study was to test the effect of varying the degree of conformity to dimensional structure in pitch and time (specifically, tonality and metre) on goodness ratings and classifications of melodies. The pitches and durations of melodies were either presented in their original order, as a reordered sequence, or replaced with random elements. Musically trained and untrained participants (24 each) rated melodic goodness, attending selectively to the dimensions of pitch, time, or both. Also, 24 trained participants classified whether or not the melodies were tonal, metric, or both. Pitch and temporal manipulations always influenced responses, but participants successfully emphasized either dimension in accordance with instructions. Effects of pitch and time were mostly independent for selective attention conditions, but more interactive when evaluating both dimensions. When interactions occurred, the effect of either dimension increased as the other dimension conformed more to its original structure. Relative main effect sizes (| pitch η² – time η² |) predicted the strength of pitch–time interactions (pitch?×?time η²); interactions were stronger when main effect sizes were more evenly matched. These results have implications for dimensional integration in several domains. Relative main effect size could serve as an indicator of dimensional salience, such that interactions are more likely when dimensions are equally salient.     

Impaired categorical perception of lexical tones in Mandarin-speaking congenital amusics

The degree to which cognitive resources are shared in the processing of musical pitch and lexical tones remains uncertain. Testing Mandarin amusics on their categorical perception of Mandarin lexical tones may provide insight into this issue. In the present study, a group of 15 amusic Mandarin speakers identified and discriminated Mandarin tones presented as continua in separate blocks. The tonal continua employed were from a high-level tone to a mid-rising tone and from a high-level tone to a high-falling tone. The two tonal continua were made in the contexts of natural speech and of nonlinguistic analogues. In contrast to the controls, the participants with amusia showed no improvement for discrimination pairs that crossed the classification boundary for either speech or nonlinguistic analogues, indicating a lack of categorical perception. The lack of categorical perception of Mandarin tones in the amusic group shows that the pitch deficits in amusics may be domain-general, and this suggests that the processing of musical pitch and lexical tones may share certain cognitive resources and/or processes (Patel 2003, 2008, 2012).     

Effects of Phonetic Similarity in the Identification of Mandarin Tones

Tonal languages differ in how they use phonetic correlates e.g. average pitch height and pitch direction, for tonal contrasts. Thus, native speakers of a tonal language may need to adjust their attention to familiar or unfamiliar phonetic cues when perceiving non-native tones. On the other hand, speakers of a non-tonal language may need to develop sensitivity to tonal correlates absent from their native system. The current study examines and compares five language groups’ perception of two synthesized Mandarin tones: the high level tone and the high falling tone. It aims to examine how listeners from tonal and non-tonal backgrounds identify and categorize acoustically equidistant pitches varying along two phonetic dimensions: pitch onset and slope. Results reveal “universal” perceptual patterns across groups and also tendencies caused by native tonal systems. Our findings confirm that L1 tonal and prosodic systems affect speakers’ sensitivity to novel perceptual cues and their abilities to discern relevant phonetic differences.     

Auditory feedback in music performance: the role of melodic structure and musical skill

Five experiments explored whether fluency in musical sequence production relies on matches between the contents of auditory feedback and the planned outcomes of actions. Participants performed short melodies from memory on a keyboard while musical pitches that sounded in synchrony with each keypress (feedback contents) were altered. Results indicated that altering pitch contents can disrupt production, but only when altered pitches form a sequence that is structurally similar to the planned sequence. These experiments also addressed the role of musical skill: Experiments 1 and 3 included trained pianists; other experiments included participants with little or no musical training. Results were similar across both groups with respect to the disruptive effects of auditory feedback manipulations. These results support the idea that a common hierarchical representation guides sequences of actions and the perception of event sequences and that this coordination is not acquired from learned associations formed by musical skill acquisition.     

Spatial representation of pitch height: the SMARC effect

Through the preferential pairing of response positions to pitch, here we show that the internal representation of pitch height is spatial in nature and affects performance, especially in musically trained participants, when response alternatives are either vertically or horizontally aligned. The finding that our cognitive system maps pitch height onto an internal representation of space, which in turn affects motor performance even when this perceptual attribute is irrelevant to the task, extends previous studies on auditory perception and suggests an interesting analogy between music perception and mathematical cognition. Both the basic elements of mathematical cognition (i.e. numbers) and the basic elements of musical cognition (i.e. pitches), appear to be mapped onto a mental spatial representation in a way that affects motor performance.