The role of perceptual integration in the recognition of assimilated word forms

We investigated how spoken words are recognized when they have been altered by phonological assimilation. Previous research has shown that there is a process of perceptual compensation for phonological assimilations. Three recently formulated proposals regarding the mechanisms for compensation for assimilation make different predictions with regard to the level at which compensation is supposed to occur as well as regarding the role of specific language experience. In the present study, Hungarian words and nonwords, in which a viable and an unviable liquid assimilation was applied, were presented to Hungarian and Dutch listeners in an identification task and a discrimination task. Results indicate that viably changed forms are difficult to distinguish from canonical forms independent of experience with the assimilation rule applied in the utterances. This reveals that auditory processing contributes to perceptual compensation for assimilation, while language experience has only a minor role to play when identification is required.     

The recognition of phonologically assimilated words does not depend on specific language experience

In a series of 5 experiments, we investigated whether the processing of phonologically assimilated utterances is influenced by language learning. Previous experiments had shown that phonological assimilations, such as /lean#bacon/ → [leam bacon], are compensated for in perception. In this article, we investigated whether compensation for assimilation can occur without experience with an assimilation rule using automatic event-related potentials. Our first experiment indicated that Dutch listeners compensate for a Hungarian assimilation rule. Two subsequent experiments, however, failed to show compensation for assimilation by both Dutch and Hungarian listeners. Two additional experiments showed that this was due to the acoustic properties of the assimilated utterance, confirming earlier reports that phonetic detail is important in compensation for assimilation. Our data indicate that compensation for assimilation can occur without experience with an assimilation rule, in line with phonetic-phonological theories that assume that speech production is influenced by speech-perception abilities.     

Perceptual processing of partially and fully assimilated words in French

Models of speech perception attribute a different role to contextual information in the processing of assimilated speech. This study concerned perceptual processing of regressive voice assimilation in French. This phonological variation is asymmetric in that assimilation is partial for voiced stops and nearly complete for voiceless stops. Two auditory-visual cross-modal form priming experiments were used to examine perceptual compensation for assimilation in French words with voiceless versus voiced stop offsets. The results show that, for the former segments, assimilating context enhances underlying form recovery, whereas it does not for the latter. These results suggest that two sources of information -- contextual information and bottom-up information from the assimilated forms themselves -- are complementary and both come into play during the processing of fully or partially assimilated word forms.     

Cross-modal priming and explicit memory in patients with verbal production deficits

Implicit memory is often thought to reflect an influence of past experience on perceptual processes, yet priming effects are found when the perceptual format of stimuli changes between study and test episodes. Such cross-modal priming effects have been hypothesized to depend upon stimulus recoding processes whereby a stimulus presented in one modality is converted to other perceptual formats. The present research examined recoding accounts of cross-modal priming by testing patients with verbal production deficits that presumably impair the conversion of visual words into auditory/phonological forms. The patients showed normal priming in a visual stem completion task following visual study (Experiment 1), but showed impairments following auditory study in both implicit (Experiment 2) and explicit (Experiment 3) stem completion. The results are consistent with the hypothesis that verbal production processes contribute to the recoding of visual stimuli and support cross-modal priming. The results also indicate that shared processes contribute to both explicit memory and cross-modal implicit memory.     

Continuous perception and graded categorization: electrophysiological evidence for a linear relationship between the acoustic signal and perceptual encoding of speech

Speech sounds are highly variable, yet listeners readily extract information from them and transform continuous acoustic signals into meaningful categories during language comprehension. A central question is whether perceptual encoding captures acoustic detail in a one-to-one fashion or whether it is affected by phonological categories. We addressed this question in an event-related potential (ERP) experiment in which listeners categorized spoken words that varied along a continuous acoustic dimension (voice-onset time, or VOT) in an auditory oddball task. We found that VOT effects were present through a late stage of perceptual processing (N1 component, ~100 ms poststimulus) and were independent of categorization. In addition, effects of within-category differences in VOT were present at a postperceptual categorization stage (P3 component, ~450 ms poststimulus). Thus, at perceptual levels, acoustic information is encoded continuously, independently of phonological information. Further, at phonological levels, fine-grained acoustic differences are preserved along with category information.     

In search of perceptual priming in a semantic classification task

Four experiments tested for perceptual priming for written words in a semantic categorization task. Repetition priming was obtained for low-frequency words when unrelated categorizations were performed at study and test (Experiment 1), but it was not orthographically mediated given that written-to-written and spoken-to-written word priming was equivalent (Experiments 2 and 3). Furthermore, no priming was obtained between pictures and words (Experiment 4), suggesting that the nonorthographic priming was largely phonological rather than semantic. These results pose a challenge to standard perceptual theories of priming that should expect orthographic priming when words are presented in a visual format at study and test.     

The development of a phonological illusion: a cross-linguistic study with Japanese and French infants

In adults, native language phonology has strong perceptual effects. Previous work has shown that Japanese speakers, unlike French speakers, break up illegal sequences of consonants with illusory vowels: they report hearing abna as abuna. To study the development of phonological grammar, we compared Japanese and French infants in a discrimination task. In Experiment 1, we observed that 14-month-old Japanese infants, in contrast to French infants, failed to discriminate phonetically varied sets of abna-type and abuna-type stimuli. In Experiment 2, 8-month-old French and Japanese did not differ significantly from each other. In Experiment 3, we found that, like adults, Japanese infants can discriminate abna from abuna when phonetic variability is reduced (single item). These results show that the phonologically induced /u/ illusion is already experienced by Japanese infants at the age of 14 months. Hence, before having acquired many words of their language, they have grasped enough of their native phonological grammar to constrain their perception of speech sound sequences.     

编码方式与指拼特征在聋生手语词加工中的作用研究

本研究探讨了聋生在加工手语词过程中不同编码方式和指拼特征的影响。实验1采用指拼类手语词和手势类手语词考察了指拼有无对手语词编码方式的影响。实验2则采用不同特征的指拼类手语词,深入考察指拼位置、指拼形式对手语词编码方式的影响。结果表明,聋生较语音编码更擅长使用指拼编码加工手语词;指拼与手势的加工存在显著差异,指拼在聋生手语词加工中起到了促进作用;指拼位置与指拼形式共同作用于手语词的加工过程。     

Are Words Easier to Learn From Infant‐ Than Adult‐Directed Speech? A Quantitative Corpus‐Based Investigation

We investigate whether infant‐directed speech (IDS) could facilitate word form learning when compared to adult‐directed speech (ADS). To study this, we examine the distribution of word forms at two levels, acoustic and phonological, using a large database of spontaneous speech in Japanese. At the acoustic level we show that, as has been documented before for phonemes, the realizations of words are more variable and less discriminable in IDS than in ADS. At the phonological level, we find an effect in the opposite direction: The IDS lexicon contains more distinctive words (such as onomatopoeias) than the ADS counterpart. Combining the acoustic and phonological metrics together in a global discriminability score reveals that the bigger separation of lexical categories in the phonological space does not compensate for the opposite effect observed at the acoustic level. As a result, IDS word forms are still globally less discriminable than ADS word forms, even though the effect is numerically small. We discuss the implication of these findings for the view that the functional role of IDS is to improve language learnability.     

What Do Second Language Listeners Know About Spoken Words? Effects of Experience and Attention in Spoken Word Processing

With a goal of investigating psycholinguistic bases of spoken word processing in a second language (L2), this study examined L2 learners' sensitivity to phonological information in spoken L2 words as a function of their L2 experience and attentional demands of a learning task. Fifty-two Chinese learners of English who differed in amount of L2 experience (longer vs. shorter residence in L2 environment) were tested in an auditory word priming experiment on well-known L2 words under two processing orientation conditions (semantic, control). Results revealed that, with more L2 experience, learners become more sensitive to phonological detail in spoken L2 words but that attention to word meaning might eliminate this sensitivity, even for learners with more L2 experience.     

双语即时切换下非目标语言语音和语义的激活状态

本研究采用双语即时切换范式, 探讨非熟练中英双语者在对目标语言(启动词)语音或语义的加工过程中非目标语言的激活状态。实验1设置了与启动词的翻译对等词存在语音相关或无关的两类配对词, 要求被试进行语音判断任务, 结果表明, 不论哪种切换条件, 两类配对词在反应时和P200成分上都没有差异, 说明目标语言在语音加工过程中非目标语言的语音层面没有得到自动激活, 从而没有产生启动效应。实验2则设置了语义相关和无关配对词, 并进行语义判断任务, 结果在两种切换条件下都发现明显的语义启动效应及N400差异, 说明非目标语言在语义层面上有得到自动激活, 但激活的程度表现出切换方向上的不一致, L1-L2切换下的语义启动量要明显大于L2-L1, 并且L1-L2的N400差异主要表现在前部脑区, 持续时间更久, 而L2-L1的N400差异主要表现在后部脑区, 但持续时间较短, 表明对于非熟练的双语者来说, 不同切换方向下对共享语义表征的激活加工是不一样的。     

Discrimination training of phonemic contrasts enhances phonological processing in mainstream school children

Auditory perceptual learning has been proposed as effective for remediating impaired language and for enhancing normal language development. We examined the effect of phonemic contrast discrimination training on the discrimination of whole words and on phonological awareness in 8- to 10-year-old mainstream school children. Eleven phonemic contrast continua were synthesised using linear interpolation coding from real speaker endpoints. Thirty children were pre-tested on the Word Discrimination Test (WDT) and the Phonological Assessment Battery (PhAB). Eighteen then trained for 12 x 30min sessions over 4 weeks using an adaptive three interval two alternative phonemic matching task. The remaining children participated in regular classroom activities. In Post-testing, trained children significantly increased their age-equivalent scores on both the WDT and PhAB by about 2 years. For the PhAB, no improvement was found in the controls. Enhanced performance in the trained children was maintained in a delayed test 5-6 weeks following training. Enhancements on the trained discriminations were weak and variable. The results indicate a dramatic improvement in phonological awareness following phonemic discrimination training without matching perceptual learning.     

Vowel bias in Danish word‐learning: processing biases are language‐specific

The present study explored whether the phonological bias favoring consonants found in French‐learning infants and children when learning new words (Havy & Nazzi, 2009; Nazzi, 2005) is language‐general, as proposed by Nespor, Peña and Mehler (2003), or varies across languages, perhaps as a function of the phonological or lexical properties of the language in acquisition. To do so, we used the interactive word‐learning task set up by Havy and Nazzi (2009), teaching Danish‐learning 20‐month‐olds pairs of phonetically similar words that contrasted either on one of their consonants or one of their vowels, by either one or two phonological features. Danish was chosen because it has more vowels than consonants, and is characterized by extensive consonant lenition. Both phenomena could disfavor a consonant bias. Evidence of word‐learning was found only for vocalic information, irrespective of whether one or two phonological features were changed. The implication of these findings is that the phonological biases found in early lexical processing are not language‐general but develop during language acquisition, depending on the phonological or lexical properties of the native language.     

Frequency and Category Factors in the Reduction and Assimilation of Function Words: EPG and Acoustic Measures

Many studies have observed phonetic and phonological differences between function words and content words. However, as many of the most commonly cited function words are also very high in frequency, it is unclear whether these differences are the result of syntactic category or word frequency. This study attempts to determine whether syntactically defined function words are indeed phonologically and phonetically reduced or assimilated when word frequency is balanced. Three experiments were designed to distinguish the relative contributions of the factors of category and frequency on phonetic and phonological reduction and assimilation. Overall results suggest that syntactic category and word frequency interact with phonetic and phonological processes in a more complex way than previously believed. Experiment 1 measured final t/d dropping, a reduction process, using electropalatography (EPG). Experiment 2 examined vowel reduction using acoustic measures. In Experiment 3, palatalization, an assimilation process, was examined using EPG. Results showed that t/d dropping responds to the factor of syntactic category, whereas palatalization is affected by word frequency; vowel reduction responded to both factors, with a dominant syntactic category effect and a secondary within-category frequency effect. The implications of these findings for models of lexical representation and theories of language acquisition are discussed.     

汉-维非熟练双语者非目标语言语音激活与语义激活差异的ERP研究

采用跨语言中介启动范式,通过两个2(词对类型)*2(启动方向)被试内的ERP实验,探讨非熟练汉-维双语者非目标语言语音激活与语义激活状态的差异。结果表明:(1)L2-L1启动方向下,语音相关词对与无关词对诱发P200峰值差异更大,潜伏期更长。(2)L1-L2启动方向下,语义相关词对与无关词对诱发N400峰值差异更大,潜伏期更长。结论:(1)在加工目标语言时非熟练汉-维双语者非目标语言词汇层与概念层都激活。(2)当非目标语言是汉语时语音激活强度大,激活速度较慢;语义激活强度较小,激活速度较快。(3)当非目标语言是维吾尔语时语音激活强度小,激活速度较快;语义激活强度较大,激活速度较慢。     

Talking as doing: Language forms and public language

I discuss language forms as the primary means that language communities provide to enable public language use. As such, they are adapted to public use most notably in being linguistically significant vocal tract actions, not the categories in the mind as proposed in phonological theories. Their primary function is to serve as vehicles for production of syntactically structured sequences of words. However, more than that, phonological actions themselves do work in public language use. In particular, they foster interpersonal coordination in social activities. An intriguing property of language forms that likely reflects their emergence in social communicative activities is that phonological forms that should be meaningless (in order to serve their role in the openness of language at the level of the lexicon) are not wholly meaningless. In fact, the form-meaning “rift” is bridged bidirectionally: The smallest language forms are meaningful, and the meanings of lexical language forms generally inhere, in part, in their embodiment by understanders.     

The role of syllabic and orthographic properties of letter cues in solving word fragments

The present research examined the role of phonological and orthographic properties of cues in mediating the retrieval of words from the mental lexicon. The task required subjects to resolve fragmented words when provided with semantically related cues (e.g., spiteful:---DIC----). Phonological properties of the letter cues were manipulated such that the letters either corresponded to the syllables (e.g., DIC in vindictive) or nonsyllables (NDI) in the word. Orthographic properties of the letter cues were manipulated by selecting letter groups that either co-occurred frequently in the language or did not. In two experiments, results revealed little or no effect of the phonological variable (syllables) but a reliable effect of the orthographic variable (letter-cue frequency). Letter cues with a low frequency of co-occurrence in the language led to better completion of the fragmented words. We interpret these findings as support for models of lexical representation that are based on orthographic properties (e.g., Seidenberg & McClelland, 1989) rather than those based on phonological constraints.     

视觉词汇加工的动态神经网络及其形成

揭示大脑加工的神经网络机制成为认知神经科学研究的最新取向.本研究以视觉词汇加工脑区(VWFA)的神经功能作为切入点,探讨视觉词汇加工神经网络的动态机制及其形成.研究一考察VWFA在刺激驱动和任务调节下的动态激活,及其与语音、语义脑区所组成神经网络的动态机制.研究二通过跨文化对比以及儿童阅读发展研究,阐明语言经验对视觉词汇加工网络的塑造作用.研究三对比功能网络、静息网络以及白质纤维束联结,探讨视觉词汇加工网络的动态联结及其形成.研究结果有助于建构视觉词汇加工的神经生理模型,为基于脑科学的阅读教学和阅读障碍矫治奠定理论基础,为认知神经科学研究提供了新的思路.     

Morphological patterns in Hungarian children with Williams syndrome and the rule debates

Williams syndrome (WMS), a rare neurogenetic disorder, has been in the forefront of research in cognitive psychology for the last 10 years. Studies of grammatical development in 14 Hungarian WMS children are presented: they were examined on tasks testing regular and irregular morphology; measures of digit span were also obtained. Results on the production of accusative and plural forms confirmed for Hungarian that regardless of the frequency of the item, inflected forms of irregulars are harder to produce, and often regularized in WMS, revealing a dissociation between the rules of grammar vs. the mental lexicon. Overall performance on the morphology task is associated with the capacity of phonological short-term memory: subjects with higher span perform better on both tasks. The specification of the surprisingly close relation of phonological short-term memory with the linguistic measures awaits further study.     

Infant speech perception bootstraps word learning

By their first birthday, infants can understand many spoken words. Research in cognitive development has long focused on the conceptual changes that accompany word learning, but learning new words also entails perceptual sophistication. Several developmental steps are required as infants learn to segment, identify and represent the phonetic forms of spoken words, and map those word forms to different concepts. We review recent research on how infants' perceptual systems unfold in the service of word learning, from initial sensitivity for speech to the learning of language-specific sound patterns. Building on a recent theoretical framework and emerging new methodologies, we show how speech perception is crucial for word learning, and suggest that it bootstraps the development of a separate but parallel phonological system that links sound to meaning.