Music-to-language transfer effect: may melodic ability improve learning of tonal languages by native nontonal speakers?

In tonal languages, as Mandarin Chinese and Thai, word meaning is partially determined by lexical tones. Previous studies suggest that lexical tones are processed by native listeners as linguistic information and not as pure tonal information. This study aims at verifying if, in nontonal languages speakers, the discrimination of lexical Mandarin tones varies in function of the melodic ability. Forty-six students with no previous experience of Mandarin or any other tonal language were presented with two short lists of spoken monosyllabic Mandarin words and invited to perform a same–different task trying to identify whether the variation were phonological or tonal. Main results show that subjects perform significantly better in identifying phonological variations rather than tonal ones and interestingly, the group with a high melodic ability (assessed by Wing subtest 3) shows a better performance exclusively in detecting tonal variations.     

普通话和粤语记忆中的语言依赖效应

通过两个实验考察普通话和粤语环境下的记忆语言依赖效应。实验1运用自传式回忆范式,考察语言环境对情境记忆提取的影响。结果表明,在普通话和粤语环境下,普通话-粤语双言被试的回忆体现了对语言环境的依赖。当回忆时的语言环境和事件发生时的语言环境相同时,获得了更多的同类记忆。实验2通过听觉方式呈现词,考察语音和语言表达方式对再认的影响。结果表明,普通话-粤语双言被试对用粤语方言表达的词反应时间短,误报率低,辨别力强,表明语音和语言表达方式是影响普通话-粤语双言被试记忆语言依赖效应的重要因素     

Processing interactions between segmental and suprasegmental information in native speakers of English and Mandarin Chinese

The processing interactions between segmental and suprasegmental information in native speakers of English and Mandarin Chinese were investigated in a speeded classification task. Since in Chinese, unlike in English, tones convey lexically meaningful information, native speakers of these languages may process combinations of segmental and suprasegment,al information differently. Subjects heard consonant-vowel syllables varying on a consonantal (segmental) dimension and either a Mandarin Chinese or constant-pitch (non-Mandarin) suprasegmental dimension. The English listeners showed mutual integrality with the Mandarin Chinese stimuli, but not the constant-pitch stimuli. The native Chinese listeners processed these dimensions with mutual integrality for both the Mandarin Chinese and the constant-pitch stimuli. These results were interpreted in terms of the linguistic function and the structure of suprasegmental information in Chinese and English. The results suggest that the way listeners perceive speech depends on the interaction between the structure of the signal and the processing strategies of the listener.     

Tone matters for Cantonese–English bilingual children’s English word reading development: A unified model of phonological transfer

Languages differ considerably in how they use prosodic features, or variations in pitch, duration, and intensity, to distinguish one word from another. Prosodic features include lexical tone in Chinese and lexical stress in English. Recent cross-sectional studies show a surprising result that Mandarin Chinese tone sensitivity is related to Mandarin–English bilingual children’s English word reading. This study explores the mechanism underlying this relation by testing two explanations of these effects: the prosodic hypothesis and segmental phonological awareness transfer. We administered multiple measures of Cantonese tone sensitivity, English stress sensitivity, segmental phonological awareness in Cantonese and English, nonverbal ability, and English word reading to 123 Cantonese–English bilingual children ages 7 and 8 years. Structural equation modeling revealed a longitudinal prediction of Cantonese tone sensitivity to English word reading between 8 and 9 years of age. This relation was realized through two parallel routes. In one, Cantonese tone sensitivity predicted English stress sensitivity, and English stress sensitivity, in turn, significantly predicted English word reading, as postulated by the prosodic hypothesis. In the second, Cantonese tone sensitivity predicted English word reading through the transfer of segmental phonological awareness between Cantonese and English, as predicted by segmental phonological transfer. These results support a unified model of phonological transfer, emphasizing the role of tone in English word reading for Cantonese–English bilingual children.     

Strategies for visual word recognition and orthographical depth: a multilingual comparison

We investigated the psychological reality of the concept of orthographical depth and its influence on visual word recognition by examining naming performance in Hebrew, English, and Serbo-Croatian. We ran three sets of experiments in which we used native speakers and identical experimental methods in each language. Experiment 1 revealed that the lexical status of the stimulus (high-frequency words, low-frequency words, and nonwords) significantly affected naming in Hebrew (the deepest of the three orthographies). This effect was only moderate in English and nonsignificant in Serbo-Croatian (the shallowest of the three orthographies). Moreover, only in Hebrew did lexical status have similar effects on naming and lexical decision performance. Experiment 2 revealed that semantic priming effects in naming were larger in Hebrew than in English and completely absent in Serbo-Croatian. Experiment 3 revealed that a large proportion of nonlexical tokens (nonwords) in the stimulus list affects naming words in Hebrew and in English, but not in Serbo-Croatian. These results were interpreted as strong support for the orthographical depth hypothesis and suggest, in general, that in shallow orthographies phonology is generated directly from print, whereas in deep orthographies phonology is derived from the internal lexicon.     

Implicit Association Test (IAT) Studies Investigating Pitch-Shape Audiovisual Cross-modal Associations Across Language Groups

Previous studies have shown that Chinese speakers and non-Chinese speakers exhibit different patterns of cross-modal congruence for the lexical tones of Mandarin Chinese, depending on which features of the pitch they attend to. But is this pattern of language-specific listening a conscious cultural strategy or an automatic processing effect? If automatic, does it also apply when the same pitch contours no longer sound like speech? Implicit Association Tests (IATs) provide an indirect measure of cross-modal association. In a series of IAT studies, conducted with participants with three kinds of language backgrounds (Chinese-dominant bilinguals, Chinese balanced bilinguals, and English speakers with no Chinese experience) we find language-specific congruence effects for Mandarin lexical tones but not for matched sine-wave stimuli. That is, for linguistic stimuli, non-Chinese speakers show advantages for pitch-height congruence (high-pointy, low-curvy); no congruence effects were found for Chinese speakers. For non-linguistic stimuli, all participant groups showed advantages for pitch-height congruence. The present findings suggest that non-lexical tone congruence (high-pointy, low-curvy) is a basic congruence pattern, and the acquisition of a language with lexical tone can alter this perception.     

Dichotic Perception of Mandarin Tones by Chinese and American Listeners

The dichotic perception of Mandarin tones by native and nonnative listeners was examined in order to investigate the lateralization of lexical tone. Twenty American listeners with no tone language background and 20 Chinese listeners were asked to identify dichotically presented tone pairs by identifying which tone they heard in each ear. For the Chinese listeners, 57% of the total errors occurred via the left ear, indicating a significant right ear advantage. However, the American listeners revealed no significant ear preference, with 48% of the errors attributable to the left ear. These results indicated that Mandarin tones are predominantly processed in the left hemisphere by native Mandarin speakers, whereas they are bilaterally processed by American English speakers with no prior tone experience. The results also suggest that the left hemisphere superiority for native Mandarin tone processing is similar to native processing of other tone languages.     

Repetition Priming Effects in Proficient Mandarin–Cantonese and Cantonese–Mandarin Bidialectals: An Event-Related Potential Study

The present study adopted a repetition priming paradigm to investigate the bidialectal (bilingual) representation of speakers with different native dialects by event-related potential (ERP) technique. Proficient Mandarin–Cantonese and Cantonese–Mandarin bidialectals participated in the study. They were required to judge whether a word was a biological word or not, when the words (target word) were represented under four types of repetition priming conditions: Mandarin (prime)–Mandarin (target), Mandarin (prime)–Cantonese (target), Cantonese (prime)–Cantonese (target) and Cantonese (prime)–Mandarin (target). Results of reaction time and accuracy primarily indicated larger repetition priming effects in Mandarin–Mandarin and Cantonese–Cantonese (within-language) conditions than that in Mandarin–Cantonese and Cantonese–Mandarin (between-language) conditions. But more importantly, P200 and N400 mean amplitudes revealed distinct repetition priming effects between two types of participants. Specifically, both P200 and N400 indicated that the repetition priming effect in Mandarin–Mandarin condition was larger than that in Cantonese–Cantonese condition for Mandarin–Cantonese participants, whereas it was opposite for Cantonese–Mandarin participants. In addition, P200 also suggested opposite patterns of repetition priming effects in between-language priming conditions for two groups of participants. The repetition priming effect in Mandarin–Cantonese condition was larger than that in Cantonese–Mandarin condition for Mandarin–Cantonese participants, while for Cantonese–Mandarin participants, it was opposite (Mandarin–Cantonese < Cantonese–Mandarin). The results implied a clear asymmetric representation of two dialects for proficient bidialectals. They were further discussed in light of native dialect and language use frequency.     

Impaired categorical perception of lexical tones in Mandarin-speaking congenital amusics

The degree to which cognitive resources are shared in the processing of musical pitch and lexical tones remains uncertain. Testing Mandarin amusics on their categorical perception of Mandarin lexical tones may provide insight into this issue. In the present study, a group of 15 amusic Mandarin speakers identified and discriminated Mandarin tones presented as continua in separate blocks. The tonal continua employed were from a high-level tone to a mid-rising tone and from a high-level tone to a high-falling tone. The two tonal continua were made in the contexts of natural speech and of nonlinguistic analogues. In contrast to the controls, the participants with amusia showed no improvement for discrimination pairs that crossed the classification boundary for either speech or nonlinguistic analogues, indicating a lack of categorical perception. The lack of categorical perception of Mandarin tones in the amusic group shows that the pitch deficits in amusics may be domain-general, and this suggests that the processing of musical pitch and lexical tones may share certain cognitive resources and/or processes (Patel 2003, 2008, 2012).     

非熟练潮-粤双言者的语义通达：来自听觉词加工的证据

采用听觉跨语言启动的语义判断范式, 考察非熟练潮-粤双言者的两种方言之间的语义通达方式。结果发现, 无论是以潮语词为启动词, 还是以粤语词为启动词, 当二者具有翻译关系时, 启动词均促进对目标词的识别, 但L1对L2的启动量比L2对L1的启动量大。当启动词与目标词具有语义联想关系时, 启动词亦能促进对目标词的识别, 但L1→L2与L2→L1的启动量差异不显著。整个研究表明, 非熟练潮-粤双言者的两种方言的词汇独立表征, 语义共享表征; 第二方言的词汇能够直接通达语义表征, 不需要以第一方言的词汇为中介, 但双言的词汇表征与语义表征的联结强度仍然存在着不对称性。     

Mandarin speech perception by ear and eye follows a universal principle

In this study, the nature of speech perception of native Mandarin Chinese was compared with that of American English speakers, using synthetic visual and auditory continua (from /ba/ to /da/) in an expanded factorial design. In Experiment 1, speakers identified synthetic unimodal and bimodal speech syllables as either /ba/ or /da/. In Experiment 2, Mandarin speakers were given nine possible response alternatives. Syllable identification was influenced by both visual and auditory sources of information for both Mandarin and English speakers. Performance was better described by the fuzzy logical model of perception than by an auditory dominance model or a weighted-averaging model. Overall, the results are consistent with the idea that although there may be differences in information (which reflect differences in phonemic repertoires, phonetic realizations of the syllables, and the phonotactic constraints of languages), the underlying nature of audiovisual speech processing is similar across languages.     

双言舌尖现象的产生机制：来自粤语-普通话双言者的证据

舌尖现象(Tip-of-the-Tongue phenomenon, TOT)是言语产生中的一种常见现象。国外研究发现, 双语者和单语者的舌尖现象差异很大。双言和双语既相似, 又存在差异。以粤语–普通话双言者为被试, 比较了普通话熟练和不熟练的被试在使用不同语言命名时的TOT产生率。结果发现：(1)粤语–普通话双言者的TOT率受普通话熟练程度影响。普通话不熟练的粤语–普通话双言者用普通话命名时产生更高的TOT率。(2)语言启动能够调节粤语–普通话双言者的普通话熟练程度与TOT产生的关系。在语言启动条件下, 普通话熟练的粤语–普通话双言者的TOT率更高。(3)粤语–普通话双言者的TOT产生机制符合部分激活理论的预言。     

How linguistic and cultural forces shape conceptions of time: English and Mandarin time in 3D

In this paper we examine how English and Mandarin speakers think about time, and we test how the patterns of thinking in the two groups relate to patterns in linguistic and cultural experience. In Mandarin, vertical spatial metaphors are used more frequently to talk about time than they are in English; English relies primarily on horizontal terms. We present results from two tasks comparing English and Mandarin speakers' temporal reasoning. The tasks measure how people spatialize time in three-dimensional space, including the sagittal (front/back), transverse (left/right), and vertical (up/down) axes. Results of Experiment 1 show that people automatically create spatial representations in the course of temporal reasoning, and these implicit spatializations differ in accordance with patterns in language, even in a non-linguistic task. Both groups showed evidence of a left-to-right representation of time, in accordance with writing direction, but only Mandarin speakers showed a vertical top-to-bottom pattern for time (congruent with vertical spatiotemporal metaphors in Mandarin). Results of Experiment 2 confirm and extend these findings, showing that bilinguals' representations of time depend on both long-term and proximal aspects of language experience. Participants who were more proficient in Mandarin were more likely to arrange time vertically (an effect of previous language experience). Further, bilinguals were more likely to arrange time vertically when they were tested in Mandarin than when they were tested in English (an effect of immediate linguistic context).     

The Differential Role of Syllabic Structure in Stem Completion for French and English

Four experiments were carried out to examine the role of a word's internal structure (i.e. syllables) in stem completion for French and English speakers. Subjects studied a series of unrelated words, selected so that two words shared their initial consonant-vowel-consonant (CVC) segment (e.g. BALANCE-BALCON). Subjects were then presented with CV or CVC stems (e.g. BA or BAL), half of which corresponded to the studied words' initial segment, and were asked to produce the first word that came to mind. Half the subjects performed the entire task in the auditory modality, half did so in the visual modality (Experiment 1). In both modalities, French subjects completed the stems more often with studied words in which the initial syllable matched the stem structure (e.g. BALCON for BAL) than with studied words that did not match (e.g. BALANCE for BAL). These syllabic effects were dissociable from explicit memory (Experiment 2) and appear to be language-specific, since they were obtained with French speakers but not with English speakers (Experiments 3 and 4). The results are highly consistent with the notion that implicit memory for words reflects the operations of perceptual phonological representations which are organised differently in French and English.     

加工水平对普通话与粤语记忆语言依赖效应的影响

通过两个实验,考察了加工水平对普通话和粤语记忆语言依赖效应的影响。实验1考察了在有意学习中的记忆语言依赖效应。结果表明,测验的语言环境对再认有重要影响。被试在粤语测验环境下对学习过的韩国语词再认反应时短,误报率却低,辨别力强,“记得”反应占优势。实验2考察了无意学习中的记忆语言依赖效应。结果表明,被试在粤语测验环境下,对评定过的韩国语词再认反应时短,误报率却高,辨别力差,但“记得”反应占优势;但在普通话测验环境下,对评定过的韩国语词再认反应时长,误报率却低,辨别力强,“知道”和“猜测”反应增加。整个研究表明,记忆的语言依赖效应在有意学习和无意学习中都存在,但有不同的趋势,表明加工水平是影响普通话和粤语记忆语言依赖效应的重要变量     

Encoding lexical tones in jTRACE: a simulation of monosyllabic spoken word recognition in Mandarin Chinese

Despite its prevalence as one of the most highly influential models of spoken word recognition, the TRACE model has yet to be extended to consider tonal languages such as Mandarin Chinese. A key reason for this is that the model in its current state does not encode lexical tone. In this report, we present a modified version of the jTRACE model in which we borrowed on its existing architecture to code for Mandarin phonemes and tones. Units are coded in a way that is meant to capture the similarity in timing of access to vowel and tone information that has been observed in previous studies of Mandarin spoken word recognition. We validated the model by first simulating a recent experiment that had used the visual world paradigm to investigate how native Mandarin speakers process monosyllabic Mandarin words (Malins & Joanisse, 2010). We then subsequently simulated two psycholinguistic phenomena: (1) differences in the timing of resolution of tonal contrast pairs, and (2) the interaction between syllable frequency and tonal probability. In all cases, the model gave rise to results comparable to those of published data with human subjects, suggesting that it is a viable working model of spoken word recognition in Mandarin. It is our hope that this tool will be of use to practitioners studying the psycholinguistics of Mandarin Chinese and will help inspire similar models for other tonal languages, such as Cantonese and Thai.     

前分类声音存储器对声调和情绪韵律的加工

采用系列位置回忆任务, 探讨作为声调语言的汉语普通话中声调及情绪信息是否具有近因及后缀效应, 从而揭示同为超音段信息的声调和情绪韵律在前分类声音存储器(Precategorical Acoustic Storage, PAS)中是否具有单独的表征, 及该表征可能受到哪些因素的影响。实验一和二分别考察了声调是否具有近因和后缀效应, 实验三和四分别考察了情绪信息是否具有近因和后缀效应。实验结果发现两者均在PAS存储器中有单独的表征, 但这种表征会受到一些因素的影响, 且受影响的方式不一样。研究结果表明作为超音段信息的声调和情绪信息在表征上的不稳定性和脆弱性, 及在短时记忆加工过程中的特殊性。     

Cross-Language Perception of Cantonese Vowels Spoken by Native and Non-native Speakers

This study examined the effect of native language background on listeners’ perception of native and non-native vowels spoken by native (Hong Kong Cantonese) and non-native (Mandarin and Australian English) speakers. They completed discrimination and an identification task with and without visual cues in clear and noisy conditions. Results indicated that visual cues did not facilitate perception, and performance was better in clear than in noisy conditions. More importantly, the Cantonese talker’s vowels were the easiest to discriminate, and the Mandarin talker’s vowels were as intelligible as the native talkers’ speech. These results supported the interlanguage speech native intelligibility benefit patterns proposed by Hayes-Harb et al. (J Phonetics 36:664–679, 2008). The Mandarin and English listeners’ identification patterns were similar to those of the Cantonese listeners, suggesting that they might have assimilated Cantonese vowels to their closest native vowels. In addition, listeners’ perceptual patterns were consistent with the principles of Best’s Perceptual Assimilation Model (Best in Speech perception and linguistic experience: issues in cross-language research. York Press, Timonium, 1995).     

熟练粤语-普通话双言者听觉词的语言表征*

以熟练粤语-普通话双言者为被试, 考察粤语-普通话双言者对听觉词的语言表征。实验1呈现粤语和普通话同形异音的词, 实验2呈现粤语和普通话异形异音的词, 要求被试做语义决定。结果发现, 粤语-普通话双言者对听觉词的语言表征类似于双语者, 即普通话和粤语的语义共同表征, 词汇分别表征。所以如此, 是由粤语的特点和它与普通话的关系决定的。