Absolute pitch and tempo in mothers' songs to infants

We examined the relative stability of pitch, tempo, and rhythm in maternal speech and singing to prelinguistic infants. Mothers were recorded speaking and singing to their infants on two occasions separated by 1 week or more. The pitch level and tempo of identical utterances were highly variable across the 1-week period, but these features were virtually unchanged in song repetitions. Rhythmic patterning was largely maintained in speech, as in song. Mothers' accurate reproduction of their sung performances can be considered a form of absolute pitch and absolute tempo.     

Effects of altered auditory feedback across effector systems: production of melodies by keyboard and singing

We report an experiment that tested whether effects of altered auditory feedback (AAF) during piano performance differ from its effects during singing. These effector systems differ with respect to the mapping between motor gestures and pitch content of auditory feedback. Whereas this action-effect mapping is highly reliable during phonation in any vocal motor task (singing or speaking), mapping between finger movements and pitch occurs only in limited situations, such as piano playing. Effects of AAF in both tasks replicated results previously found for keyboard performance (Pfordresher, 2003), in that asynchronous (delayed) feedback slowed timing whereas alterations to feedback pitch increased error rates, and the effect of asynchronous feedback was similar in magnitude across tasks. However, manipulations of feedback pitch had larger effects on singing than on keyboard production, suggesting effector-specific differences in sensitivity to action-effect mapping with respect to feedback content. These results support the view that disruption from AAF is based on abstract, effector independent, response-effect associations but that the strength of associations differs across effector systems.     

Enhanced production and perception of musical pitch in tone language speakers

Individuals differ markedly with respect to how well they can imitate pitch through singing and in their ability to perceive pitch differences. We explored whether the use of pitch in one’s native language can account for some of the differences in these abilities. Results from two studies suggest that individuals whose native language is a tone language, in which pitch contributes to word meaning, are better able to imitate (through singing) and perceptually discriminate musical pitch. These findings support the view that language acquisition fine-tunes the processing of critical auditory dimensions in the speech signal and that this fine-tuning can be carried over into nonlinguistic domains.     

Facial expressions of singers influence perceived pitch relations

In four experiments, we examined whether facial expressions used while singing carry musical information that can be “read” by viewers. In Experiment 1, participants saw silent video recordings of sung melodic intervals and judged the size of the interval they imagined the performers to be singing. Participants discriminated interval sizes on the basis of facial expression and discriminated large from small intervals when only head movements were visible. Experiments 2 and 3 confirmed that facial expressions influenced judgments even when the auditory signal was available. When matched with the facial expressions used to perform a large interval, audio recordings of sung intervals were judged as being larger than when matched with the facial expressions used to perform a small interval. The effect was not diminished when a secondary task was introduced, suggesting that audio-visual integration is not dependent on attention. Experiment 4 confirmed that the secondary task reduced participants’ ability to make judgments that require conscious attention. The results provide the first evidence that facial expressions influence perceived pitch relations.     

Auditory imagery and the poor-pitch singer

The vocal imitation of pitch by singing requires one to plan laryngeal movements on the basis of anticipated target pitch events. This process may rely on auditory imagery, which has been shown to activate motor planning areas. As such, we hypothesized that poor-pitch singing, although not typically associated with deficient pitch perception, may be associated with deficient auditory imagery. Participants vocally imitated simple pitch sequences by singing, discriminated pitch pairs on the basis of pitch height, and completed an auditory imagery self-report questionnaire (the Bucknell Auditory Imagery Scale). The percentage of trials participants sung in tune correlated significantly with self-reports of vividness for auditory imagery, although not with the ability to control auditory imagery. Pitch discrimination was not predicted by auditory imagery scores. The results thus support a link between auditory imagery and vocal imitation.     

A frog in your throat or in your ear? Searching for the causes of poor singing

Singing is a cultural universal and an important part of modern society, yet many people fail to sing in tune. Many possible causes have been posited to explain poor singing abilities; foremost among these are poor perceptual ability, poor motor control, and sensorimotor mapping errors. To help discriminate between these causes of poor singing, we conducted 5 experiments testing musicians and nonmusicians in pitch matching and judgment tasks. Experiment 1 introduces a new instrument called a slider, on which participants can match pitches without using their voice. Pitch matching on the slider can be directly compared with vocal pitch matching, and results showed that both musicians and nonmusicians were more accurate using the slider than their voices to match target pitches, arguing against a perceptual explanation of singing deficits. Experiment 2 added a self-matching condition and showed that nonmusicians were better at matching their own voice than a synthesized voice timbre, but were still not as accurate as on the slider. This suggests a timbral translation type of mapping error. Experiments 3 and 4 demonstrated that singers do not improve over multiple sung responses, or with the aid of a visual representation of pitch. Experiment 5 showed that listeners were more accurate at perceiving the pitch of the synthesized tones than actual voice tones. The pattern of results across experiments demonstrates multiple possible causes of poor singing, and attributes most of the problem to poor motor control and timbral-translation errors, rather than a purely perceptual deficit, as other studies have suggested.     

Judging the pleasantness of contour-rhythm-pitch-timbre musical combinations

The way people with various degrees of musical training integrate timbre, melodic contour, rhythm, and pitch information in an overall pleasantness judgment for musical excerpts was investigated. The theoretical and methodological framework of the study was the functional theory of cognition. In 2 experiments, participants were asked to attribute an overall pleasantness value to combinations of these factors. In Experiment 1, timbre, contour, rhythm, and overall pitch were manipulated. In Experiment 2, timbre and theme (a pattern of pitch and rhythm) were manipulated. Both experiments showed that in judging the pleasantness of musical combinations, participants apply a simple, additive rule in which the weight attributed to one element does not depend of the value of the other elements. Very few differences in regard to the combination rule were observed between participants with and without musical training. These results are discussed in reference to the controversy over pitch and rhythm interaction.     

Infants prefer higher-pitched singing

Female singers were recorded singing a song in a high and/or a low range. Infants preferred to listen to the higher-pitched versions, suggesting that infants' preference for infant-directed singing and speech is mediated in part by a preference for higher pitch.     

Tune recognition with reduced pitch and interval information

Twenty subjects were tested on their ability to recognize simple tunes from which rhythm information had been removed. Only the first phrase of each tune was presented. The purpose of the experiment was (a) to determine whether stimuli containing only high harmonics can evoke a sense of musical pitch, and (b) to provide a set of data in normal subjects with which the performance of deaf subjects whose auditory nerve is stimulated electrically can be compared. Each subject was tested on five sets of stimuli presented in a counterbalanced order. These stimuli were (I) pulse trains high-pass filtered at 2 kHz, with repetition rates in the range of 100-200 p.p.s.; (2) as in (I) but high-pass filtered at 4 kHz; (3) sinusoids with musical intervals compressed, so that the “octave” was a ratio of I:I·3; (4) sinusoids with the musical intervals expanded, so that the “octave” was a ratio of I:4; (5) sinusoids of a constant frequency in which the normal frequency changes were translated into intensity changes, each semitone being represented by a 3 dB change in level. The results indicate that a pattern of intensity changes does not support tune recognition, and that, although the pitch contour alone allows reasonable performance, subjects do use musical interval information in recognizing tunes. Stimuli containing only high harmonics can provide such interval information, and thus can evoke a sense of musical pitch. Preliminary results from a deaf subject stimulated electrically with an electrode on the surface of the cochlea indicate that such stimulation can also evoke a sense of musical pitch. It is concluded that musical pitch information can be carried in the time-pattern of nerve impulses in the auditory nerve.     

Multiple coding strategies in the retention of musical tones by possessors of absolute pitch

Eighteen musicians with absolute pitch (AP) confirmed by screening tests participated in tonal and verbal short-term-retention tasks. In the tonal task, subjects identified three successive piano tones by their letter names. Recall of these note names after 18 sec of counting backwards was near perfect. Recall after an 18-sec delay filled with random piano tones was also near perfect. In contrast, the same subjects demonstrated significant forgetting when required to retain letter trigrams while counting backwards for 18 sec. These results were essentially replicated in a second experiment using longer (27 sec) retention intervals, a more demanding verbal interference task, and an active musical interference task (singing a descending scale). We interpret these results as indicating that retention of note names by possessors of AP is not limited to verbal encoding; rather, multiple codes (e.g., auditory, kinesthetic, and visual imagery) are probably used.     

The subjective size of melodic intervals over a two-octave range

Musically trained and untrained participants provided magnitude estimates of the size of melodic intervals. Each interval was formed by a sequence of two pitches that differed by between 50 cents (one half of a semitone) and 2,400 cents (two octaves) and was presented in a high or a low pitch register and in an ascending or a descending direction. Estimates were larger for intervals in the high pitch register than for those in the low pitch register and for descending intervals than for ascending intervals. Ascending intervals were perceived as larger than descending intervals when presented in a high pitch register, but descending intervals were perceived as larger than ascending intervals when presented in a low pitch register. For intervals up to an octave in size, differentiation of intervals was greater for trained listeners than for untrained listeners. We discuss the implications for psychophysical pitch scales and models of music perception.     

Accenting and detection of timing variations in tone sequences: different kinds of accents have different effects.

The effect of intensity and pitch accents on the perception of timing was examined in two experiments using a signal detection procedure. Analyses of sensitivity and response bias revealed opposite effects of intensity and pitch accents under similar conditions. Time intervals preceding intensity accents were perceived as longer, but time intervals preceding pitch accents were perceived as shorter. These results showed that listeners found it easier to detect timing variations that were contrary to expectations, as compared with variations that were consistent with expectations. In the present case, listeners should have expected shorter time intervals before intensity accents and longer intervals before pitch accents. The fact that the effects were observed with stimuli that had minimal musical structure demonstrated the contribution of psychoacoustic factors to such phenomena.     

Accenting and detection of timing variations in tone sequences: Different kinds of accents have different effects

The effect of intensity and pitch accents on the perception of timing was examined in two experiments using a signal detection procedure. Analyses of sensitivity and response bias revealed opposite effects of intensity and pitch accents under similar conditions. Time intervals preceding intensity accents were perceived as longer, but time intervals preceding pitch accents were perceived as shorter. These results showed that listeners found it easier to detect timing variations that were contrary to expectations, as compared with variations that were consistent with expectations. In the present case, listeners should have expected shorter time intervals before intensity accents and longer intervals before pitch accents. The fact that the effects were observed with stimuli that had minimal musical structure demonstrated the contribution of psychoacoustic factors to such phenomena.     

Do you see what I’m singing? Visuospatial movement biases pitch perception

The nature of the connection between musical and spatial processing is controversial. While pitch may be described in spatial terms such as “high” or “low”, it is unclear whether pitch and space are associated but separate dimensions or whether they share representational and processing resources. In the present study, we asked participants to judge whether a target vocal note was the same as (or different from) a preceding cue note. Importantly, target trials were presented as video clips where a singer sometimes gestured upward or downward while singing that target note, thus providing an alternative, concurrent source of spatial information. Our results show that pitch discrimination was significantly biased by the spatial movement in gesture, such that downward gestures made notes seem lower in pitch than they really were, and upward gestures made notes seem higher in pitch. These effects were eliminated by spatial memory load but preserved under verbal memory load conditions. Together, our findings suggest that pitch and space have a shared representation such that the mental representation of pitch is audiospatial in nature.     

Rhythm deficits in 'tone deafness'

It is commonly observed that 'tone deaf' individuals are unable to hear the beat of a tune, yet deficits on simple timing tests have not been found. In this study, we investigated rhythm processing in nine individuals with congenital amusia ('tone deafness') and nine controls. Participants were presented with pairs of 5-note sequences, and were required to detect the presence of a lengthened interval. In different conditions the sound sequences were presented isochronously or in an integer-ratio rhythm, and these were either monotonic or varied randomly in pitch. It was found that the 'tone deaf' participants exhibited inferior rhythm analysis for the sequences that varied in pitch compared to those that did not, whereas the controls obtained equivalent thresholds for these two conditions. These results suggest that the rhythm deficits in congenital amusia result from the pitch-variations in music.     

Left-hemisphere activation is associated with enhanced vocal pitch error detection in musicians with absolute pitch

The ability to process auditory feedback for vocal pitch control is crucial during speaking and singing. Previous studies have suggested that musicians with absolute pitch (AP) develop specialized left-hemisphere mechanisms for pitch processing. The present study adopted an auditory feedback pitch perturbation paradigm combined with ERP recordings to test the hypothesis whether the neural mechanisms of the left-hemisphere enhance vocal pitch error detection and control in AP musicians compared with relative pitch (RP) musicians and non-musicians (NM). Results showed a stronger N1 response to pitch-shifted voice feedback in the right-hemisphere for both AP and RP musicians compared with the NM group. However, the left-hemisphere P2 component activation was greater in AP and RP musicians compared with NMs and also for the AP compared with RP musicians. The NM group was slower in generating compensatory vocal reactions to feedback pitch perturbation compared with musicians, and they failed to re-adjust their vocal pitch after the feedback perturbation was removed. These findings suggest that in the earlier stages of cortical neural processing, the right hemisphere is more active in musicians for detecting pitch changes in voice feedback. In the later stages, the left-hemisphere is more active during the processing of auditory feedback for vocal motor control and seems to involve specialized mechanisms that facilitate pitch processing in the AP compared with RP musicians. These findings indicate that the left hemisphere mechanisms of AP ability are associated with improved auditory feedback pitch processing during vocal pitch control in tasks such as speaking or singing.     

唱音障碍的认知神经机制

唱音障碍是“五音不全”的一种表现形式。对唱音障碍的判定依赖于具体的评估方式、测试任务及测量指标。目前来看, 采用多任务、多指标以及相对标准是较为合理的办法。发生于歌唱过程(知觉、感觉运动转换、发声运动控制、记忆)中任一加工阶段的功能缺陷都可能导致唱音障碍, 但感觉运动转换缺陷被认为是唱音障碍的主要成因。最新的MMIA模型在内部模型的基础上描述了感觉运动转换缺陷的具体机制。未来研究一方面应进一步检验并完善当前的MMIA模型, 厘清唱音障碍的认知神经机制, 另一方面应利用现有成果为个体改善和提高自身的音准提供实质性的帮助。     

Individuals with congenital amusia imitate pitches more accurately in singing than in speaking: Implications for music and language processing

In this study, we investigated the impact of congenital amusia, a disorder of musical processing, on speech and song imitation in speakers of a tone language, Mandarin. A group of 13 Mandarin-speaking individuals with congenital amusia and 13 matched controls were recorded while imitating a set of speech and two sets of song stimuli with varying pitch and rhythm patterns. The results indicated that individuals with congenital amusia were worse than controls in both speech and song imitation, in terms of both pitch matching (absolute and relative) and rhythm matching (relative time and number of time errors). Like the controls, individuals with congenital amusia achieved better absolute and relative pitch matching and made fewer pitch interval and contour errors in song than in speech imitation. These findings point toward domain-general pitch (and time) production deficits in congenital amusia, suggesting the presence of shared pitch production mechanisms but distinct requirements for pitch-matching accuracy in language and music processing.     

Infants’ perception of musical patterns

This paper examines infants’ ability to perceive various aspects of musical material that are significant in music in general and in Western European music in particular: contour, intervals, exact pitches, diatonic structure, and rhythm. For the most part, infants focus on relational aspects of melodies, synthesizing global representations from local details. They encode the contour of a melody across variations in exact pitches and intervals. They extract information about pitch direction from the smallest musically relevant pitch change in Western music, the semitone. Under certain conditions, infants detect interval changes in the context of transposed sequences, their performance showing enhancement for sequences that conform to Western musical structure. Infants have difficulty retaining exact pitches except for sets of pitches that embody important musical relations. In the temporal domain, they group the elements of auditory sequences on the basis of similarity and they extract the temporal structure of a melody across variations in tempo.     

Pitch and timing abilities in adult left-hemisphere-dysphasic and right-hemisphere-damaged subjects

The production and perception of pitch and rhythm were tested in patients with acquired unilateral left-hemisphere (LH) lesions (and subsequent motor dysphasia, n = 13), patients with unilateral right-hemisphere (RH) lesions (n = 14), and normal age-matched controls. While the LH dysphasic subjects were not generally impaired on the production or perception of pitch, they were grossly impaired on the production and perception of rhythm. The RH subjects, in contrast, were impaired on measures of pitch perception and production, including the discrimination and production of single notes and of melodies. It is concluded that the two hemispheres differ in their specialization for the perception and production of pitch and rhythm.