Pitch and pitch change interact in auditory displays

Designing auditory displays requires understanding how different attributes of sound are processed. Operators must often listen to a particular stimulus dimension and make control actions contingent on the auditory information. Three experiments used a selective-listening paradigm to examine interactions between auditory dimensions. Participants were instructed to attend to either relative pitch or direction of pitch change of dynamic stimuli. With vertically arranged keypress responses, reactions to both dimensions showed stimulus-response compatibility effects, indicating that pitch is treated spatially. Direction of pitch change affected responses to pitch; level of pitch more strongly affected responses to pitch change. To reduce deleterious effects of irrelevant pitch information, auditory display designers can restrict the pitch range used to display dynamic data.     

Independent temporal and pitch structures in determination of musical phrases

In two experiments we addressed the roles of temporal and pitch structures in judgments of melodic phrases. Musical excerpts were rated on how good or complete a phrase they made. In Experiment 1, trials in the temporal condition retained the original temporal pattern but were equitonal; trials in the pitch condition retained the original pitch pattern but were equitemporal; and trials in the melody condition contained both temporal and pitch patterns. In Experiment 2, one pattern (pitch or temporal) was shifted in phase and recombined with the other pattern to create the pitch and temporal conditions. In the melody condition, both patterns were shifted together. In both experiments, ratings in the temporal and pitch conditions were uncorrelated, and the melody condition ratings were accurately predicted by a linear combination of the pitch and temporal condition ratings. These results were consistent across musicians with varying levels of experience.     

The role of pitch and temporal diversity in the perception and production of musical sequences

In two experiments we explored how the dimensions of pitch and time contribute to the perception and production of musical sequences. We tested how dimensional diversity (the number of unique categories in each dimension) affects how pitch and time combine. In Experiment 1, 18 musically trained participants rated the complexity of sequences varying only in their diversity in pitch or time; a separate group of 18 pianists reproduced these sequences after listening to them without practice. Overall, sequences with more diversity were perceived as more complex, but pitch diversity influenced ratings more strongly than temporal diversity. Further, although participants perceived sequences with high levels of pitch diversity as more complex, errors were more common in the sequences with higher diversity in time. Sequences in Experiment 2 exhibited diversity in both pitch and time; diversity levels were a subset of those tested in Experiment 1. Again diversity affected complexity ratings and errors, but there were no statistical interactions between dimensions. Nonetheless, pitch diversity was the primary factor in determining perceived complexity, and again temporal errors occurred more often than pitch errors. Additionally, diversity in one dimension influenced error rates in the other dimension in that both error types were more frequent relative to Experiment 1. These results suggest that although pitch and time do not interact directly, they are nevertheless not processed in an informationally encapsulated manner. The findings also align with a dimensional salience hypothesis, in which pitch is prioritised in the processing of typical Western musical sequences.     

Global and local pitch perception in children with developmental dyslexia

This study investigated global versus local pitch pattern perception in children with dyslexia aged between 8 and 11 years. Children listened to two consecutive 4-tone pitch sequences while performing a same/different task. On the different trials, sequences either preserved the contour (local condition) or they violated the contour (global condition). Compared to normally developing children, dyslexics showed robust pitch perception deficits in the local but not the global condition. This finding was replicated in a simple pitch direction task, which minimizes sequencing and short term memory. Results are consistent with a left-hemisphere deficit in dyslexia because local pitch changes are supposedly processed by the left hemisphere, whereas global pitch changes are processed by the right hemisphere. The present data suggest a link between impaired pitch processing and abnormal phonological development in children with dyslexia, which makes pitch pattern processing a potent tool for early diagnosis and remediation of dyslexia.     

Response bias in category and magnitude estimation of difference and similarity for loudness and pitch

Interval scales of sensory magnitude were derived from magnitude and category estimates of loudness differences, loudness similarities, pitch differences, and pitch similarities. In each of the four loudness experiments, a loudness scale was constructed from a nonmetric analysis of the rank order of the judgments. The four loudness scales so constructed were found to be equivalent to one another and indicated that loudness was a power function of sound pressure with an exponent of .29. A similar analysis for the four pitch experiments found the pitch scales derived in each case to be equivalent to one another and linear with the mel scale of pitch. Thus the same sensory and similarities for two distinct perceptual continua. For both pitch and loudness, these sensory scales were used to generate scales of sensory differences. A comparison of the category and magnitude estimates of sensory differences with the scale of sensory differences derived from the nonmetric analyses indicated the presence of significant response biases in both category and magnitude estimation procedures.     

失歌症者对音乐和言语音高的加工

音高是音乐和言语领域中一个重要维度。失歌症是一种对音乐音高加工的障碍。探讨失歌症者对音乐和言语音高的加工有助于揭示音乐和言语音高加工是否共享特定的认知和神经机制。已有研究结果表明, 失歌症者对音乐音高加工存在障碍, 这种音高障碍在一定程度上影响到言语音高加工。同时, 声调语言背景无法弥补失歌症者的音高障碍。这些研究结果支持了资源－共享框架(resource-sharing framework), 即音乐和语言共享特定的认知和神经机制(Patel, 2003, 2008, in press), 并可能在一定程度上为失语症临床治疗提供借鉴。     

Auditory imagery and the poor-pitch singer

The vocal imitation of pitch by singing requires one to plan laryngeal movements on the basis of anticipated target pitch events. This process may rely on auditory imagery, which has been shown to activate motor planning areas. As such, we hypothesized that poor-pitch singing, although not typically associated with deficient pitch perception, may be associated with deficient auditory imagery. Participants vocally imitated simple pitch sequences by singing, discriminated pitch pairs on the basis of pitch height, and completed an auditory imagery self-report questionnaire (the Bucknell Auditory Imagery Scale). The percentage of trials participants sung in tune correlated significantly with self-reports of vividness for auditory imagery, although not with the ability to control auditory imagery. Pitch discrimination was not predicted by auditory imagery scores. The results thus support a link between auditory imagery and vocal imitation.     

Recognition of notated melodies by possessors and nonpossessors of absolute pitch

Musically trained listeners compared a notated melody presented visually and a comparison melody presented auditorily, and judged whether they were exactly the same or not, with respect to relative pitch. Listeners who had absolute pitch showed the poorest performance for melodies transposed to different pitch levels from the notated melodies, whereas they exhibited the highest performance for untransposed melodies. By comparison, the performance of melody recognition by listeners who did not have absolute pitch was not influenced by the actual pitch level at which melodies were played. These results suggest that absolute-pitch listeners tend to rely on absolute pitch even in recognizing transposed melodies, for which the absolute-pitch strategy is not useful.     

Earwitness memory: distortions for voice pitch and speaking rate

In two experiments, memory distortions for voice pitch and speaking rate were examined. In both experiments, a significant distortion effect for voice pitch was observed, with listeners biased towards selecting voices lower in pitch than low‐pitch targets and selecting voices higher in pitch than high‐pitch targets. In contrast, for speaking rate there was little evidence for the production of memory distortions. The results are discussed in terms of transient surface properties of speech and how transience may be a factor in producing distortions. The results have implications for how errors arise during earwitness testimony for a suspect's voice. Copyright © 2009 John Wiley & Sons, Ltd.     

Recognition of notated melodies by possessors and nonpossessors of absolute pitch

Musically trained listeners compared a notated melody presented visually and a comparison melody presented auditorily, and judged whether they were exactly the same or not, with respect to relative pitch. Listeners who had absolute pitch showed the poorest performance for melodies transposed to different pitch levels from the notated melodies, whereas they exhibited the highest performance for untransposed melodies. By comparison, the performance of melody recognition by listeners who did not have absolute pitch was not influenced by the actual pitch level at which melodies were played. These results suggest that absolute-pitch listeners tend to rely on absolute pitch even in recognizing transposed melodies, for which the absolute-pitch strategy is not useful.     

On the relation between roll and pitch

Studies have found that rolling the visual environment affects observers' perception of gravitational vertical and horizontal and that pitching the environment affects observers' perception of pitch. However, the relationship between these two perceptions is not fully understood. In the present work, observers performed three tasks while in a visual surround whose pitch and roll was manipulated. In the first task, observers adjusted a rod in the frontal-parallel plane to the horizontal (roll). In a second task, they adjusted a rod along a plane parallel to straight-ahead to the vertical (pitch). In the final task (“in-between”), they adjusted a rod midway between the first two conditions. The typical pitch and roll effects were found, as well as a contribution of both pitch and roll to the in-between task. No interaction between pitch and roll effects was found, indicating independent cognitive representations.     

The role of femininity and averageness of voice pitch in aesthetic judgments of women's voices

Although averageness is preferred in auditory stimuli (eg music) and non-face objects (eg wristwatches), exaggerated feminine characteristics are preferred to averageness in female faces. To establish whether or not men prefer femininity in female voices to average characteristics, we conducted a correlational study (study 1) to assess the relationship between voice pitch and attractiveness ratings. We found a positive linear relationship between voice pitch and attractiveness ratings. In study 2 we manipulated pitch in women's voices with low (lower than average), average, and high (higher than average) starting pitches and gauged men's preferences. Men preferred women's voices with raised pitch for all levels of starting pitch. These findings suggest that men prefer high voice pitch to average voice pitch in women's voices.     

The interdependence of pitch and temporal judgments by absolute pitch possessors

The auditory tau and the kappa effects show that there is time-pitch interdependence in our perception. Our judgments of pitch separation between two tones depend on the temporal interval between them (the auditory tau effect), and our judgments of the tones’ temporal interval depend on their pitch separation (the kappa effect). The mechanisms underlying this interdependence were investigated by studying the auditory tau and the kappa effect in three experiments. Comparisons were made between results obtained from subjects with absolute pitch and those who did not have absolute pitch, and two frequency ranges of pure tones (octave and whole-tone conditions) were selected. The procedures had been used in previous experiments (Shigeno, 1986), in which the auditory tau and the kappa effects were compared in speech and nonspeech stimuli. The present results demonstrate that the auditory tau effect does not occur when possessors of absolute pitch judge the closeness of stimuli in pitch, except when the stimulus continuum consists of tones that do not correspond to musical notes in the whole-tone condition. The kappa effect was obtained in the judgment of possessors of absolute pitch in both the octave and the whole-tone conditions. These findings suggest that the interaction between temporal interval and pitch judgment might be explained in terms of the two different memory modes for retaining the pitch of tones, and that these effects occur at the precategorical level.     

Individual pitch functions and pitch-duration cross-dimensional matching

Eight young adult subjects scaled the auditory dimensions of duration and pitch using a modified method of numerical magnitude balance and adjustment of the stimuli for individual equal-loudness differences. Individual duration and pitch functions for magnitude estimation and for magnitude production fit the power law well. When compared with the revised reel scale and the pitch function obtained by S. S. Stevens and Galanter (Journal of Experimental psychology, 1957,54, 377–411), the group magnitude estimation and magnitude production pitch functions plotted in log-log coordinates showed high degrees of linearity. This was due mostly to the absence of a rollover in the high-frequency range of the continuum. It was hypothesized that pitch may be viewed as a linear function. This hypothesis was further supported when the exponents of the pitch and duration functions were used to predict closely the group exponent of cross-dimension matches.     

Illusory conjunctions of pitch and duration in unfamiliar tone sequences

In 3 experiments, the authors examined short-term memory for pitch and duration in unfamiliar tone sequences. Participants were presented a target sequence consisting of 2 tones (Experiment 1) or 7 tones (Experiments 2 and 3) and then a probe tone. Participants indicated whether the probe tone matched 1 of the target tones in both pitch and duration. Error rates were relatively low if the probe tone matched 1 of the target tones or if it differed from target tones in pitch, duration, or both. Error rates were remarkably high, however, if the probe tone combined the pitch of 1 target tone with the duration of a different target tone. The results suggest that illusory conjunctions of these dimensions frequently occur. A mathematical model is presented that accounts for the relative contribution of pitch errors, duration errors, and illusory conjunctions of pitch and duration.     

Enhanced production and perception of musical pitch in tone language speakers

Individuals differ markedly with respect to how well they can imitate pitch through singing and in their ability to perceive pitch differences. We explored whether the use of pitch in one’s native language can account for some of the differences in these abilities. Results from two studies suggest that individuals whose native language is a tone language, in which pitch contributes to word meaning, are better able to imitate (through singing) and perceptually discriminate musical pitch. These findings support the view that language acquisition fine-tunes the processing of critical auditory dimensions in the speech signal and that this fine-tuning can be carried over into nonlinguistic domains.     

Perceptual interactions between musical pitch and timbre.

These experiments examined perceptual interactions between musical pitch and timbre. Experiment 1, through the use of the Garner classification tasks, found that pitch and timbre of isolated tones interact. Classification times showed interference from uncorrelated variation in the irrelevant attribute and facilitation from correlated variation; the effects were symmetrical. Experiments 2 and 3 examined how musical pitch and timbre function in longer sequences. In recognition memory tasks, a target tone always appeared in a fixed position in the sequences, and listeners were instructed to attend to either its pitch or its timbre. For successive tones, no interactions between timbre and pitch were found. That is, changing the pitches of context tones did not affect timbre recognition, and vice versa. The tendency to perceive pitch in relation to other context pitches was strong and unaffected by whether timbre was constant or varying. In contrast, the relative perception of timbre was weak and was found only when pitch was constant. These results suggest that timbre is perceived more in absolute than in relative terms. Perceptual implications for creating patterns in music with timbre variations are discussed.     

Some perceptual dependencies in speeded classification of vowel color and pitch

Wood (1975) suggested that information specifying consonant identity is dependent on the earlier processing of pitch. Is vowel identification also dependent on the prior processing of pitch? In contrast with the results obtained with consonants, Kuhl (1975, 1976) reported that infants responded selectively to differences in vowel color when pitch varied but not to differences in pitch when vowel color varied. Miller (1978) has also reported that adults show mutual, symmetric interference effects in speeded classification of vowel color and pitch, In the present study, judgments of vowel color and pitch were examined in a reaction time task in order to assess the effects of the relative discriminability of vowel and pitch quality on speeded classification. In addition, we also compared the classification of isolated vowels to vowels in consonantal context. The overall results were consistent with both Kuhl’s and Miller’s earlier findings but refine our understanding of the interaction between various dimensions by showing that vowel identification is also dependent on the processing of pitch information. Such an interaction, however, becomes evident only when the processing dependencies are examined across a wide range of stimulus values for each dimension. The present findings provide additional information about the nature of processing dependencies among dimensions in speech and the methods by which such dependencies may be studied.     

Influence of tonal context and timbral variation on perception of pitch

In this study, spectral timbre's effect on pitch perception is examined in varying contexts. In two experiments, subjects detected pitch deviations of tones differing in brightness in an isolated context in which they compared two tones, in a tone-series context in which they judged whether the last tone of a simple sequence was in or out of tune, and in a melodic context in which they determined whether the last note of familiar melodies was in or out of tune. Timbre influenced pitch judgments in all the conditions, but increasing tonal context allowed the subjects to extract pitch information more accurately. This appears to be due to two factors: (1) The presence of extra tones creates a stronger reference point from which to judge pitch, and (2) the melodies' tonal structure gives more cues that facilitate pitch extraction, even in the face of conflicting spectral information.     

Contributions of temporal and place cues in pitch perception in absolute pitch possessors

Pitch perception is determined by both place and temporal cues. To explore whether the manner in which these cues are used differs depending on absolute pitch capability, pitch identification experiments with and without pitch references were conducted for subjects with different absolute pitch capabilities and musical experience. Three types of stimuli were used to manipulate place and temporal cues separately: narrowband noises, which provide strong place cues but less salient temporal cues; iterated rippled noises, which provide strong temporal cues but less salient place cues; and sinusoidal tones, which provide both. The results indicated that absolute pitch possessors utilize temporal cues more effectively when they identify musical chroma With regard to the judgment of height, it was indicated that place cues play an important role for both absolute and nonabsolute pitch possessors.