Predicting lexical accent perception in native Japanese speakers: An investigation of acoustic pitch sensitivity and working memory

Spoken language perception may be constrained by a listener's cognitive resources, including verbal working memory (WM) capacity and basic auditory perception mechanisms. For Japanese listeners, it is unknown how, or even if, these resources are involved in the processing of pitch accent at the word level. The present study examined the extent to which native Japanese speakers could make correctness judgments on and categorize spoken Japanese words by pitch accent pattern, and how verbal WM capacity and acoustic pitch sensitivity related to perception ability. Results showed that Japanese listeners were highly accurate at judging pitch accent correctness (M = 93%), but that the more cognitively demanding accent categorization task yielded notably lower performance (M = 61%). Of chief interest was the finding that acoustic pitch sensitivity significantly predicted accuracy scores on both perception tasks, while verbal WM had a predictive role only for the categorization of a specific accent pattern. These results indicate first, that task demands greatly influence accuracy and second, that basic cognitive capacities continue to support perception of lexical prosody even in adult listeners.     

Online recognition of music is influenced by relative and absolute pitch information

Three experiments explored online recognition in a nonspeech domain, using a novel experimental paradigm. Adults learned to associate abstract shapes with particular melodies, and at test they identified a played melody's associated shape. To implicitly measure recognition, visual fixations to the associated shape versus a distractor shape were measured as the melody played. Degree of similarity between associated melodies was varied to assess what types of pitch information adults use in recognition. Fixation and error data suggest that adults naturally recognize music, like language, incrementally, computing matches to representations before melody offset, despite the fact that music, unlike language, provides no pressure to execute recognition rapidly. Further, adults use both absolute and relative pitch information in recognition. The implicit nature of the dependent measure should permit use with a range of populations to evaluate postulated developmental and evolutionary changes in pitch encoding.     

A Domain-General Theory of the Development of Perceptual Discrimination

ABSTRACT— In this article, we posit a domain-general principle that may account for the improvement that is observed in several aspects of perceptual development over the first years of life. Development during this time frame is characterized by a process of perceptual narrowing, whereby the discrimination of perceptual information is broadly tuned at first and then declines to more selective levels with experience. This process appears to cut across both the visual and auditory modalities and may reflect the development of a common neural architecture.     

Distinct Facial Characteristics Differentiate Communicative Intent of Infant‐Directed Speech

Adults and infants can differentiate communicative messages using the nonlinguistic acoustic properties of infant‐directed (ID) speech. Although the distinct prosodic properties of ID speech have been explored extensively, it is currently unknown whether the visual properties of the face during ID speech similarly convey communicative intent and thus represent an additional source of social information for infants during early interactions. To examine whether the dynamic facial movement associated with ID speech confers affective information independent of the acoustic signal, adults' differentiation of the visual properties of speakers' communicative messages was examined in two experiments in which the adults rated silent videos of approving and comforting ID and neutral adult‐directed speech. In Experiment 1, adults differentiated the facial speech groups on ratings of the intended recipient and the speaker's message. In Experiment 2, an original coding scale identified facial characteristics of the speakers. Discriminant correspondence analysis revealed two factors differentiating the facial speech groups on various characteristics. Implications for perception of ID facial movements in relation to speakers' communicative intent are discussed for both typically and atypically developing infants. Copyright © 2012 John Wiley & Sons, Ltd.     

Discrimination of Lexical Tones in the First Year of Life

In the current study, we examined the developmental course of the perception of non‐native tonal contrast. We tested 4, 6 and 12‐month‐old Dutch infants on their discrimination of Chinese low‐rising tone and low‐dipping tone using the visual fixation paradigm. The infants were tested in two conditions that differed in terms of degree of variability. The 4‐month‐olds did not show discrimination effect in either condition. The 6‐ and 12‐month‐old infants, however, discriminated the tones in both conditions. The improvement of perception might be the result of cognitive development carried over from learning the native phonology. Infants can become better listeners in general in the first year of life, as well as get cognitively better equipped in dealing with the variable input in speech in general. Copyright © 2015 John Wiley & Sons, Ltd.     

自闭症者对音乐和言语音高的加工

自闭症是一种神经发展障碍,主要表现为社会互动障碍,语言交流困难以及刻板行为等症状。已有研究表明,在音乐方面,自闭症者不仅表现出较强的音乐音高知觉能力,而且在音乐表演方面也体现出某些优势。然而,在言语方面,自闭症者除了在言语音高轮廓分辨任务中得分较高外,对言语语调的知觉能力明显比正常人更差,同时,他们对言语语调的产生也存在障碍。本研究不仅可以推进音乐和言语对比研究,而且也为自闭症者言语康复提供借鉴。     

声调范畴感知和声调复杂度对音乐音高感知的跨领域影响

采用音高识别与区分任务, 以汉语母语者、越南语母语者和俄语母语者为研究对象, 考察了两个语言加工层面的因素, 即声调范畴感知模式以及不同语言声调系统的复杂度差异对跨领域音乐音高感知的影响。结果发现: (1)汉语和越南语两组声调语言母语者听辨结果符合范畴感知模式, 而俄语母语者是连续感知。在语言和音乐两种刺激条件下, 声调语言母语者在范畴边界宽度、范畴内区分率、范畴间区分率以及区分峰度等指标上不存在显著差异。(2)汉语和越南语两组声调语言母语者的音乐音高区分任务结果差异不显著。实验结果表明: 在行为层面, 母语声调范畴感知模式可以迁移到音乐音高感知中, 但复杂声调系统并不能促进跨领域的音乐音高精细感知。实验结果从语言对音乐音高加工影响的角度支持了“共享论”。     

Olfactory preferences resulting from mere exposure in human neonates

Twenty-four (12 males, 12 females) healthy, full-term neonates were exposed to an artificial odorant within the first day after birth for approximately 24 hrs to determine if mere exposure would lead to a subsequent preference for that odor. In choice tests following the treatment period, female infants displayed preferential orientation to the exposure odor. Males, in contrast, displayed no evidence of preference for the exposure odor; rather, they demonstrated a right turning bias regardless of odor location. These data suggest that familiarization with an odor shortly after birth is sufficient for female infants to develop preferential responsiveness to that odor.     

Newborns discriminate utterance-level prosodic contours

Prosody is the fundamental organizing principle of spoken language, carrying lexical, morphosyntactic, and pragmatic information. It, therefore, provides highly relevant input for language development. Are infants sensitive to this important aspect of spoken language early on? In this study, we asked whether infants are able to discriminate well-formed utterance-level prosodic contours from ill-formed, backward prosodic contours at birth. This deviant prosodic contour was obtained by time-reversing the original one, and super-imposing it on the otherwise intact segmental information. The resulting backward prosodic contour was thus unfamiliar to the infants and ill-formed in French. We used near-infrared spectroscopy (NIRS) in 1-3-day-old French newborns (n = 25) to measure their brain responses to well-formed contours as standards and their backward prosody counterparts as deviants in the frontal, temporal, and parietal areas bilaterally. A cluster-based permutation test revealed greater responses to the Deviant than to the Standard condition in right temporal areas. These results suggest that newborns are already capable of detecting utterance-level prosodic violations at birth, a key ability for breaking into the native language, and that this ability is supported by brain areas similar to those in adults.

Research Highlights

• At birth, infants have sophisticated speech perception abilities.
• Prosody may be particularly important for early language development.
• We show that newborns are already capable of discriminating utterance-level prosodic contours.
• This discrimination can be localized to the right hemisphere of the neonate brain.

     

How Infants Adapt Speech-Processing Capacities to Native-Language Structure

As infants learn the sound organization of their native language, they use this developing knowledge to make their first attempts to extract the underlying structure of utterances. Although these first attempts fail to capture the full complexity of features that adults use in perceiving and producing utterances, they provide learners with the opportunity to discover additional cues to the underlying structure of the language. Three examples of this developmental pattern are considered: learning the rhythmic organization of the native language, segmenting words from fluent speech, and identifying the correct units of grammatical organization.     

How big is this sound? Crossmodal association between pitch and size in infants

We examined 4- and 6-month-old infants’ sensitivity to the perceptual association between pitch and object size. Crossmodal correspondence effects were observed in 6-month-old infants but not in younger infants, suggesting that experience and/or further maturation is needed to fully develop this crossmodal association.     

The influence of music-elicited emotions and relative pitch on absolute pitch memory for familiar melodies

Levitin's findings that nonmusicians could produce from memory the absolute pitches of self-selected pop songs have been widely cited in the music psychology literature. These findings suggest that latent absolute pitch (AP) memory may be a more widespread trait within the population than traditional AP labelling ability. However, it has been left unclear what factors may facilitate absolute pitch retention for familiar pieces of music. The aim of the present paper was to investigate factors that may contribute to latent AP memory using Levitin's sung production paradigm for AP memory and comparing results to the outcomes of a pitch labelling task, a relative pitch memory test, measures of music-induced emotions, and various measures of participants' musical backgrounds. Our results suggest that relative pitch memory and the quality and degree of music-elicited emotions impact on latent AP memory.     

The moment‐to‐moment pitch dynamics of child‐directed speech shape toddlers’ attention and learning

Young children have an overall preference for child‐directed speech (CDS) over adult‐directed speech (ADS), and its structural features are thought to facilitate language learning. Many studies have supported these findings, but less is known about processing of CDS at short, sub‐second timescales. How do the moment‐to‐moment dynamics of CDS influence young children's attention and learning? In Study 1, we used hierarchical clustering to characterize patterns of pitch variability in a natural CDS corpus, which uncovered four main word‐level contour shapes: ‘fall’, ‘rise’, ‘hill’, and ‘valley’. In Study 2, we adapted a measure from adult attention research—pupil size synchrony—to quantify real‐time attention to speech across participants, and found that toddlers showed higher synchrony to the dynamics of CDS than to ADS. Importantly, there were consistent differences in toddlers’ attention when listening to the four word‐level contour types. In Study 3, we found that pupil size synchrony during exposure to novel words predicted toddlers’ learning at test. This suggests that the dynamics of pitch in CDS not only shape toddlers’ attention but guide their learning of new words. By revealing a physiological response to the real‐time dynamics of CDS, this investigation yields a new sub‐second framework for understanding young children's engagement with one of the most important signals in their environment.     

When faces and voices come together: Face width-to-height ratio and voice pitch contribute independently to social perception

Prior research has shown that the face's width-to-height ratio (fWHR) and the voice's pitch influence social perception. Yet, the relative contribution of either cue has been largely unexplored. We examined the simultaneous effects of fWHR and pitch on social evaluations. Experiment 1 (N = 102) tested how such cues shaped global impressions. Experiment 2 (N = 121) tested fWHR and pitch's effect on behavioural affiliative intentions, framing social interaction as a physical or an intellectual competition. Experiment 3 (N = 57) assessed whether variations in fWHR and pitch could influence trait attribution (i.e., physical formidability and intelligence). Individuals with large faces or low-pitched voices elicited negative impressions, positive behavioural intentions in a physical competition, and the attribution of stronger formidability but lower intelligence. Across the studies, cues exerted independent effects. The implications of these findings for research on cross-modal social perception are discussed.     

Left-hemisphere activation is associated with enhanced vocal pitch error detection in musicians with absolute pitch

The ability to process auditory feedback for vocal pitch control is crucial during speaking and singing. Previous studies have suggested that musicians with absolute pitch (AP) develop specialized left-hemisphere mechanisms for pitch processing. The present study adopted an auditory feedback pitch perturbation paradigm combined with ERP recordings to test the hypothesis whether the neural mechanisms of the left-hemisphere enhance vocal pitch error detection and control in AP musicians compared with relative pitch (RP) musicians and non-musicians (NM). Results showed a stronger N1 response to pitch-shifted voice feedback in the right-hemisphere for both AP and RP musicians compared with the NM group. However, the left-hemisphere P2 component activation was greater in AP and RP musicians compared with NMs and also for the AP compared with RP musicians. The NM group was slower in generating compensatory vocal reactions to feedback pitch perturbation compared with musicians, and they failed to re-adjust their vocal pitch after the feedback perturbation was removed. These findings suggest that in the earlier stages of cortical neural processing, the right hemisphere is more active in musicians for detecting pitch changes in voice feedback. In the later stages, the left-hemisphere is more active during the processing of auditory feedback for vocal motor control and seems to involve specialized mechanisms that facilitate pitch processing in the AP compared with RP musicians. These findings indicate that the left hemisphere mechanisms of AP ability are associated with improved auditory feedback pitch processing during vocal pitch control in tasks such as speaking or singing.     

婴儿对语音和非语音的感知:认知和神经机制

婴儿听觉感知能力的发展对于他们未来的语言学习和社会化都具有重要意义。过去大量的研究主要关注语音感知方面,只有较少的研究将非语音感知纳入考虑之中,但了解非语音感知的特征和机制将有助于增加研究者对听觉加工以及儿童发育的认识。该文分别介绍了婴儿语音感知中的三种偏好——对语音、“婴儿语”和母语的偏好,并尝试着将非语音分为音乐、人类的非言语发声、环境声音三类进行阐述。通过对比这两大类声音的感知得到婴儿可能存在语音感知的左脑偏侧化和音乐感知的右脑偏侧化现象,但这也尚存争议,目前有特定领域模型、特定线索模型和脑网络模型三种理论对偏侧化现象的认知机制进行解释。     

A developmental study of latent absolute pitch memory

The ability to recall the absolute pitch level of familiar music (latent absolute pitch memory) is widespread in adults, in contrast to the rare ability to label single pitches without a reference tone (overt absolute pitch memory). The present research investigated the developmental profile of latent absolute pitch (AP) memory and explored individual differences related to this ability. In two experiments, 288 children from 4 to12 years of age performed significantly above chance at recognizing the absolute pitch level of familiar melodies. No age-related improvement or decline, nor effects of musical training, gender, or familiarity with the stimuli were found in regard to latent AP task performance. These findings suggest that latent AP memory is a stable ability that is developed from as early as age 4 and persists into adulthood.