Ups and Downs in Auditory Development: Preschoolers’ Sensitivity to Pitch Contour and Timbre

Much research has explored developing sound representations in language, but less work addresses developing representations of other sound patterns. This study examined preschool children's musical representations using two different tasks: discrimination and sound–picture association. Melodic contour—a musically relevant property—and instrumental timbre, which is (arguably) less musically relevant, were tested. In Experiment 1, children failed to associate cartoon characters to melodies with maximally different pitch contours, with no advantage for melody preexposure. Experiment 2 also used different‐contour melodies and found good discrimination, whereas association was at chance. Experiment 3 replicated Experiment 2, but with a large timbre change instead of a contour change. Here, discrimination and association were both excellent. Preschool‐aged children may have stronger or more durable representations of timbre than contour, particularly in more difficult tasks. Reasons for weaker association of contour than timbre information are discussed, along with implications for auditory development.     

Tempo discrimination of musical patterns: Effects due to pitch and rhythmic structure

The purpose of this research was to investigate a set of factors that may influence the perceived rate of an auditory event. In a paired-comparison task, subjects were presented with a set of music-like patterns that differed in their relative number of contour changes and in the magnitude of pitch skips (Experiment 1) as well as in the compatibility of rhythmic accent structure with the arrangement of pitch relations (Experiment 2). Results indicated that, relative to their standard referents, comparison melodies were judged to unfold more slowly when they displayed more changes in pitch direction, greater pitch distances, and an incompatible rhythmic accent structure. These findings are suggested to stern from animputed velocity hypo thesis, in which people overgeneralize certain invariant relations that typically occur between melodic and temporal accent structure within Western music.     

The influence of linguistic experience on the cognitive processing of pitch in speech and nonspeech sounds

In the present experiment, the authors tested Mandarin and English listeners on a range of auditory tasks to investigate whether long-term linguistic experience influences the cognitive processing of nonspeech sounds. As expected, Mandarin listeners identified Mandarin tones significantly more accurately than English listeners; however, performance did not differ across the listener groups on a pitch discrimination task requiring fine-grained discrimination of simple nonspeech sounds. The crucial finding was that cross-language differences emerged on a nonspeech pitch contour identification task: The Mandarin listeners more often misidentified flat and falling pitch contours than the English listeners in a manner that could be related to specific features of the sound structure of Mandarin, which suggests that the effect of linguistic experience extends to nonspeech processing under certain stimulus and task conditions.     

Detection of acoustic repetition for very long stochastic patterns

Guttman and Julesz (1963) employed recycling frozen noise segments (RFNs) as model stimuli in their classic study of the lower limits for periodicity detection and short-term auditory memory. They reported that listeners can hear iteration of these stochastic signals effortlessly as "motorboating" for repetition periods ranging from 50 to 250 msec and as "whooshing" from 250 msec to 1 sec. Both motorboating and whooshing RFNs are global percepts encompassing the entire period, as are RFNs in the pitch range (repetition periods shorter than 50 msec). However, with continued listening to whooshing (but not motorboating) RFNs, individuals hear recurrent brief components such as clanks and thumps that are characteristic of the particular waveform. Experiment 1 of the present study describes a cross-modal cuing procedure that enables listeners to store and then recognize the recurrence of portions of frozen noise waveforms that are repeated after intervals of 10 sec or more. Experiment 2 compares the relative saliencies of different spectral regions in enabling listeners to detect repetition of these long-period patterns. Special difficulty was encountered with the 6-kHz band of RFNs, possibly due to the lack of fine-structure phase locking at this frequency range. In addition, a similarity is noted between the organizational principles operating over particular durational ranges of stochastic patterns and the characteristics of traditional hierarchical units of speech having corresponding durations.     

Recognizing melodies: A dynamic interpretation

Two experiments explore hypotheses about rhythm and contour in recognition of simple pitch strings (melodies). Target melodies that differed with respect to pitch relationships (interval and contour pitch differences) and rhythm, were presented to ordinary listeners who were told to learn the melodies (Phase I). In a subsequent recognition test (Phase II), listeners had to recognize these same target melodies although they were transposed to a different musical key. In recognition, target melodies appeared in the original rhythm or in new rhythms that simulated some pause properties of the original rhythm. Target melodies were interspersed with decoy melodies that either preserved the pitch contour of targets or did not; all appeared in the original rhythm and in new rhythms. Results indicated that a new rhythmic context lowered recognizability of target melodies, and that decoys were most confusing when they possessed the same “dynamic shape” (contour-plus-rhythm) as targets (Experiment 1). Also, target recognition improved with Phase I familiarity (Experiment 2), although rhythmic shifts remained detrimental across levels of target familiarity. Confusions based on “dynamic shape” accounted for a relatively high proportion of errors where familiarity with targets is low. Findings were interpreted in terms of a theory of context-sensitive dynamic attending in which remembering is assumed to involve recapitulation of the original rhythmical activities involved in attending to melodies.     

Evaluation of an imputed pitch velocity model of the auditory tau effect

This article extends an imputed pitch velocity model of the auditory kappa effect proposed by Henry and McAuley (2009a) to the auditory tau effect. Two experiments were conducted using an AXB design in which listeners judged the relative pitch of a middle target tone (X) in ascending and descending three-tone sequences. In Experiment 1, sequences were isochronous, establishing constant fast, medium, and slow velocity conditions. No systematic distortions in perceived target pitch were observed, and thresholds were similar across velocity conditions. Experiment 2 introduced to-be-ignored variations in target timing. Variations in target timing that deviated from constant velocity conditions introduced systematic distortions in perceived target pitch, indicative of a robust auditory tau effect. Consistent with an auditory motion hypothesis, the magnitude of the tau effect was larger at faster velocities. In addition, the tau effect was generally stronger for descending sequences than for ascending sequences. Combined with previous work on the auditory kappa effect, the imputed velocity model and associated auditory motion hypothesis provide a unified quantitative account of both auditory tau and kappa effects. In broader terms, these findings add support to the view that pitch and time relations in auditory patterns are fundamentally interdependent.     

Infant music perception: domain-general or domain-specific mechanisms?

We review the literature on infants' perception of pitch and temporal patterns, relating it to comparable research with human adult and non-human listeners. Although there are parallels in relative pitch processing across age and species, there are notable differences. Infants accomplish such tasks with ease, but non-human listeners require extensive training to achieve very modest levels of performance. In general, human listeners process auditory sequences in a holistic manner, and non-human listeners focus on absolute aspects of individual tones. Temporal grouping processes and categorization on the basis of rhythm are evident in non-human listeners and in human infants and adults. Although synchronization to sound patterns is thought to be uniquely human, tapping to music, synchronous firefly flashing, and other cyclic behaviors can be described by similar mathematical principles. We conclude that infants' music perception skills are a product of general perceptual mechanisms that are neither music- nor species-specific. Along with general-purpose mechanisms for the perceptual foundations of music, we suggest unique motivational mechanisms that can account for the perpetuation of musical behavior in all human societies.     

Higher order pattern structure influences auditory representational momentum

Representational momentum refers to the phenomenon that observers tend to incorrectly remember an event undergoing real or implied motion as shifted beyond its actual final position. This has been demonstrated in both visual and auditory domains. In 5 pitch discrimination experiments, listeners heard tone sequences that implied either linear, periodic, or null motions in pitch space. Their task was to judge whether the pitch of a probe tone following each sequence was the same or different from the final sequence tone. Results suggested that listeners made errors consistent with extrapolation of coherent pitch patterns (linear, periodic) but not with incoherent (null) ones. Hypotheses associated with internalized physical principles and pattern-based expectations are discussed.     

Multi-Encoding for Pitch Information of Tone Sequences

This study was designed to investigate the possibilities that subjects would visualize an auditory contour as a visual contour (visual imagery) to encode pitch information of tone sequences (Experiment 1), and that subjects would be motivated to attempt to engage in covert rehearsal with multi-code (Experiment 2). The findings from these experiments suggest that: (a) Whereas the highly musically trained subjects were able to encode pitches as accurate notes on a staff, the less well musically trained subjects encoded the pitch sequence as a contour. It is quite evident that there is an intermodal analogy between the perception of pitch relationships and that of relationships in visual space. (b) Pitch rehearsal of auditory information along with note names (dual-code) and staff notation accompanied by pitch rehearsal with note names (triple-code) were the most effective strategies for highly trained subjects with pitches of tonal sequences; melodic contour accompanied by pitch rehearsal (dual-code) was used by highly trained subjects with atonal sequences and by less well trained subjects with both types of sequences.     

Children's perception of certain musical properties: scale and contour

Children's perception of scale and contour in melodies was investigated in five studies. Experimental tasks included judging transposed renditions of melodies (Studies 1 and 3), discriminating between transposed renditions of a melody (Study 2), judging contour-preserving transformations of melodies (Study 4), and judging similarity to a familiar target melody of transformations preserving rhythm or rhythm and contour (Study 5). The first and second studies showed that young children detect key transposition changes even in familiar melodies and they perceive similarity over key transpositions even in unfamiliar melodies. Young children also are sensitive to melodic contour over transformations that preserve it (Study 5), yet they distinguish spontaneously between melodies with the same contour and different intervals (Study 4). The key distance effect reported in the literature did not occur in the tasks of this investigation (Studies 1 and 3), and it may be apparent only for melodies shorter or more impoverished than those used here.     

Predicting lexical accent perception in native Japanese speakers: An investigation of acoustic pitch sensitivity and working memory

Spoken language perception may be constrained by a listener's cognitive resources, including verbal working memory (WM) capacity and basic auditory perception mechanisms. For Japanese listeners, it is unknown how, or even if, these resources are involved in the processing of pitch accent at the word level. The present study examined the extent to which native Japanese speakers could make correctness judgments on and categorize spoken Japanese words by pitch accent pattern, and how verbal WM capacity and acoustic pitch sensitivity related to perception ability. Results showed that Japanese listeners were highly accurate at judging pitch accent correctness (M = 93%), but that the more cognitively demanding accent categorization task yielded notably lower performance (M = 61%). Of chief interest was the finding that acoustic pitch sensitivity significantly predicted accuracy scores on both perception tasks, while verbal WM had a predictive role only for the categorization of a specific accent pattern. These results indicate first, that task demands greatly influence accuracy and second, that basic cognitive capacities continue to support perception of lexical prosody even in adult listeners.     

Tonal strength and melody recognition after long and short delays

In a continuous-running-memory task, subjects heard novel seven-note melodies that were tested after delays of 11 sec (empty) or 39 sec (filled). Test items were transposed to new pitch levels (to moderately distant keys in the musical sense)and included exact transpositions (targets), same-contour lures with altered pitch intervals, and new-contour lures. Melodies differed in tonal strength (degree of conformity to a musical key) and were tonally strong, tonally weak, or atonal. False alarms to same-contour lures decreased over the longer delay period, but only for tonal stimuli. In agreement with previous studies, discrimination of detailed changes in pitch intervals improved with increased delay, whereas discrimination of more global contour information declined, again only for tonal stimuli. These results suggest that poor short-delay performance in rejecting same-contour lures arises from confusion that is based on the similarity of tonality between standard stimuli and lures. If a test item has the same contour and a similar tonality to a just-presented item, subjects tend to accept it. After a delay filled with melodies in other tonalities, the salience of key information recedes, and subjects base their judgments on more detailed pattern information (namely, exact pitch intervals). The fact that tonality affects judgments of melodic contour indicates that contour is not an entirely separable feature of melodies but rather that a melody with its contour constitutes an integrated perceptual whole.     

Ideomotor effects of pitch on continuation tapping

The ideomotor principle predicts that perception will modulate action where overlap exists between perceptual and motor representations of action. This effect is demonstrated with auditory stimuli. Previous perceptual evidence suggests that pitch contour and pitch distance in tone sequences may elicit tonal motion effects consistent with listeners' implicit awareness of the lawful dynamics of locomotive bodies. To examine modulating effects of perception on action, participants in a continuation tapping task produced a steady tempo. Auditory tones were triggered by each tap. Pitch contour randomly and persistently varied within trials. Pitch distance between successive tones varied between trials. Although participants were instructed to ignore them, tones systematically affected finger dynamics and timing. Where pitch contour implied positive acceleration, the following tap and the intertap interval (ITI) that it completed were faster. Where pitch contour implied negative acceleration, the following tap and the ITI that it completed were slower. Tempo was faster with greater pitch distance. Musical training did not predict the magnitude of these effects. There were no generalized effects on timing variability. Pitch contour findings demonstrate how tonal motion may elicit the spontaneous production of accents found in expressive music performance.     

Tonal strength and melody recognition after long and short delays.

In a continuous-running-memory task, subjects heard novel seven-note melodies that were tested after delays of 11 sec (empty) or 39 sec (filled). Test items were transposed to new pitch levels (to moderately distant keys in the musical sense) and included exact transpositions (targets), same-contour lures with altered pitch intervals, and new-contour lures. Melodies differed in tonal strength (degree of conformity to a musical key) and were tonally strong, tonally weak, or atonal. False alarms to same-contour lures decreased over the longer delay period, but only for tonal stimuli. In agreement with previous studies, discrimination of detailed changes in pitch intervals improved with increased delay, whereas discrimination of more global contour information declined, again only for tonal stimuli. These results suggest that poor short-delay performance in rejecting same-contour lures arises from confusion that is based on the similarity of tonality between standard stimuli and lures. If a test item has the same contour and a similar tonality to a just-presented item, subjects tend to accept it. After a delay filled with melodies in other tonalities, the salience of key information recedes, and subjects base their judgments on more detailed pattern information (namely, exact pitch intervals). The fact that tonality affects judgments of melodic contour indicates that contour is not an entirely separable feature of melodies but rather that a melody with its contour constitutes an integrated perceptual whole.     

The subjective size of melodic intervals over a two-octave range

Musically trained and untrained participants provided magnitude estimates of the size of melodic intervals. Each interval was formed by a sequence of two pitches that differed by between 50 cents (one half of a semitone) and 2,400 cents (two octaves) and was presented in a high or a low pitch register and in an ascending or a descending direction. Estimates were larger for intervals in the high pitch register than for those in the low pitch register and for descending intervals than for ascending intervals. Ascending intervals were perceived as larger than descending intervals when presented in a high pitch register, but descending intervals were perceived as larger than ascending intervals when presented in a low pitch register. For intervals up to an octave in size, differentiation of intervals was greater for trained listeners than for untrained listeners. We discuss the implications for psychophysical pitch scales and models of music perception.     

Syllabic pitch perception in 2- to 3-month-old infants

The pitch patterns present in speech addressed to infants may play an important role in perceptual processing by infants. In this study, the high-amplitude sucking procedure was used to assess discrimination by 2- to 3-month-old infants of rising versus falling pitch patterns in 400-msec synthetic [ra] and [la] tokens. The syllables’ intonation contour was modeled on infant-directed speech, and covered a range characteristic of an adult female speaker (180–300 Hz). Group data indicated that the 2- to 3-month-old infants discriminated the pitch contour for both stimuli. Results are discussed with reference to previous studies of syllabic pitch perception.     

Schema-based processing in auditory scene analysis

What is the involvement of what we know in what we perceive? In this article, the contribution of melodic schema-based processes to the perceptual organization of tone sequences is examined. Two unfamiliar six-tone melodies, one of which was interleaved with distractor tones, were presented successively to listeners who were required to decide whether the melodies were identical or different. In one condition, the comparison melody was presented after the mixed sequence: a target melody interleaved with distractor tones. In another condition, it was presented beforehand, so that the listeners had precise knowledge about the melody to be extracted from the mixture. In the latter condition, recognition performance was better and a bias toward same responses was reduced, as compared with the former condition. A third condition, in which the comparison melody presented beforehand was transposed up in frequency, revealed that whereas the performance improvement was explained in part by absolute pitch or frequency priming, relative pitch representation (interval and/or contour structure) may also have played a role. Differences in performance as a function of mean frequency separation between target and distractor sequences, when listeners did or did not have prior knowledge about the target melody, argue for a functional distinction between primitive and schema-based processes in auditory scene analysis.     

Sensorimotor synchronization: motor responses to regular auditory patterns.

Subjects (N = 32) were asked to synchronize a motor response with tones in auditory patterns. These patterns were created from six tones and six intertone intervals of equal duration. The pitch of the first tone differed from the others. It was found that subjects used three types of timing in their motor response: (1) the first intertone interval was prolonged and the second interval was shortened, (2) the second intertone interval was prolonged and the first interval was shortened, and/or (3) the first interval and the second interval were of approximately the same length. The prolongation of the fifth interval was observed during all three types of timing. The results are explained using the concept of suprasegmental control of timing, which explains a prolongation of intervals at critical control point of the patterns. The occurrence of three different strategies of timing is discussed in connection with similar principles in musical performance.     

Evidence for auditory feature integration with spatially distributed items

Recent auditory research using sequentially presented, spatially fixed tones has found evidence that, as in vision for simultaneous, spatially distributed objects, attention appears to be important for the integration of perceptual features that enable the identification of auditory events. The present investigation extended these findings to arrays of simultaneously presented, spatially distributed musical tones. In the primary tasks, listeners were required to search for specific cued conjunctions of values for the features of pitch and instrument timbre. In secondary tasks, listeners were required to search for a single cued value of either the pitch or the timbre feature. In the primary tasks, listeners made frequent errors in reporting the presence or absence of target conjunctions. Probability modeling, derived from the visual search literature, revealed that the error rates in the primary tasks reflected the relatively infrequent failure to correctly identify pitch or timbre features, plus the far more frequent illusory conjunction of separately presented pitch and timbre features. Estimates of illusory conjunction rate ranged from 23% to 40%. Thus, a process must exist in audition that integrates separately registered features. The implications of the results for the processing of isolated auditory features, as well as auditory events defined by conjunctions of features, are discussed.