The influence of speech rate and accent on access and use of semantic information

Circumstances in which the speech input is presented in sub-optimal conditions generally lead to processing costs affecting spoken word recognition. The current study indicates that some processing demands imposed by listening to difficult speech can be mitigated by feedback from semantic knowledge. A set of lexical decision experiments examined how foreign accented speech and word duration impact access to semantic knowledge in spoken word recognition. Results indicate that when listeners process accented speech, the reliance on semantic information increases. Speech rate was not observed to influence semantic access, except in the setting in which unusually slow accented speech was presented. These findings support interactive activation models of spoken word recognition in which attention is modulated based on speech demands.     

Accent modulates access to word meaning: Evidence for a speaker-model account of spoken word recognition

Speech carries accent information relevant to determining the speaker’s linguistic and social background. A series of web-based experiments demonstrate that accent cues can modulate access to word meaning. In Experiments 1–3, British participants were more likely to retrieve the American dominant meaning (e.g., hat meaning of “bonnet”) in a word association task if they heard the words in an American than a British accent. In addition, results from a speeded semantic decision task (Experiment 4) and sentence comprehension task (Experiment 5) confirm that accent modulates on-line meaning retrieval such that comprehension of ambiguous words is easier when the relevant word meaning is dominant in the speaker’s dialect. Critically, neutral-accent speech items, created by morphing British- and American-accented recordings, were interpreted in a similar way to accented words when embedded in a context of accented words (Experiment 2). This finding indicates that listeners do not use accent to guide meaning retrieval on a word-by-word basis; instead they use accent information to determine the dialectic identity of a speaker and then use their experience of that dialect to guide meaning access for all words spoken by that person. These results motivate a speaker-model account of spoken word recognition in which comprehenders determine key characteristics of their interlocutor and use this knowledge to guide word meaning access.     

The semantics of prosody: acoustic and perceptual evidence of prosodic correlates to word meaning

This investigation examined whether speakers produce reliable prosodic correlates to meaning across semantic domains and whether listeners use these cues to derive word meaning from novel words. Speakers were asked to produce phrases in infant-directed speech in which novel words were used to convey one of two meanings from a set of antonym pairs (e.g., big/small). Acoustic analyses revealed that some acoustic features were correlated with overall valence of the meaning. However, each word meaning also displayed a unique acoustic signature, and semantically related meanings elicited similar acoustic profiles. In two perceptual tests, listeners either attempted to identify the novel words with a matching meaning dimension (picture pair) or with mismatched meaning dimensions. Listeners inferred the meaning of the novel words significantly more often when prosody matched the word meaning choices than when prosody mismatched. These findings suggest that speech contains reliable prosodic markers to word meaning and that listeners use these prosodic cues to differentiate meanings. That prosody is semantic suggests a reconceptualization of traditional distinctions between linguistic and nonlinguistic properties of spoken language.     

汉语口语词汇产生中的多重音韵激活：单词翻译任务的ERP研究

口语词汇产生过程中, 非目标词是否会产生音韵激活是独立两阶段模型和交互激活模型的争论焦点之一。研究运用事件相关电位技术, 考察了被试在翻译命名任务中是否受到背景图片音韵或语义干扰词的影响。行为反应时中未发现显著的音韵效应, 而语义效应显著, 表明非目标词不会产生音韵激活。事件相关电位的结果显示在目标单词呈现后的400~600 ms时间窗口中出现了显著的语义效应, 在600~700 ms时间窗口内出现了边缘显著的语义效应和音韵效应, 均表现为相关条件比无关条件波幅更正。上述结果表明在将英语翻译成汉语的过程中, 尽管在脑电上呈现出可能存在微弱的多重音韵激活, 但行为结果并不会显示出非目标项的音韵激活。研究结果支持了汉语口语词汇产生遵循独立两阶段模式的观点。     

Interaction Between Phonological and Semantic Representations: Time Matters

Computational modeling and eye‐tracking were used to investigate how phonological and semantic information interact to influence the time course of spoken word recognition. We extended our recent models (Chen & Mirman, 2012; Mirman, Britt, & Chen, 2013) to account for new evidence that competition among phonological neighbors influences activation of semantically related concepts during spoken word recognition (Apfelbaum, Blumstein, & McMurray, 2011). The model made a novel prediction: Semantic input modulates the effect of phonological neighbors on target word processing, producing an approximately inverted‐U‐shaped pattern with a high phonological density advantage at an intermediate level of semantic input—in contrast to the typical disadvantage for high phonological density words in spoken word recognition. This prediction was confirmed with a new analysis of the Apfelbaum et al. data and in a visual world paradigm experiment with preview duration serving as a manipulation of strength of semantic input. These results are consistent with our previous claim that strongly active neighbors produce net inhibitory effects and weakly active neighbors produce net facilitative effects.     

Lexical ambiguity, semantic context, and visual word recognition.

Some alternative hypotheses about the recognition of ambiguous words are considered. According to the selective-access hypothesis, prior semantic context biases people to access one meaning of an ambiguous word rather than another in lexical memory during recognition. In contrast, the nonselectiveaccess hypothesis states that all meanings of the word are accessed regardless of the context. We tested certain versions of these hypotheses by having students decide whether selected strings of letters were English words. The stimuli included test sequnces of three words in which the second word had two distinct possible meanings, whereas the first and third words were related to these meanings in various ways. When the first and third words were related to the same meaning of the ambiguous second word (e.g., SAVE-BANK-MONEY), the reaction time to recognize the third word decreased. But when the first and third words were related to different meanings of the second word (e.g., RIVER-BANK-MONEY), the reaction time for the third word was not reliably different from a control sequence with unrelated words. These and other data favor the selective-access hypothesis. Selective access to lexical memory is discussed in relation to models of word recognition.     

Facilitation of auditory word recognition

An experiment that investigated facilitation of recognition of spoken words presented in noise IS described, Prior to the test session, the subjects either read words or heard them spoken in one of two. voices while making a semantic judgment upon them. There was a large effect of auditory priming on word recognition that did not depend upon the voice (male or female) of presentation, There were much smaller, but significant, effects of prior visual experience of the words. The implications of these data for the logogen model are discussed.     

Inhibitory processes and spoken word recognition in young and older adults: the interaction of lexical competition and semantic context.

Two experiments were conducted to examine the importance of inhibitory abilities and semantic context to spoken word recognition in older and young adults. In Experiment 1, identification scores were obtained in 3 contexts: single words, low-predictability sentences, and high-predictability sentences. Additionally, identification performance was examined as a function of neighborhood density (number of items phonetically similar to a target word). Older adults had greater difficulty than young adults recognizing words with many neighbors (hard words). However, older adults also exhibited greater benefits as a result of adding contextual information. Individual differences in inhibitory abilities contributed significantly to recognition performance for lexically hard words but not for lexically easy words. The roles of inhibitory abilities and linguistic knowledge in explaining age-related impairments in spoken word recognition are discussed.     

Spoken word recognition by eye

Spoken word recognition is thought to be achieved via competition in the mental lexicon between perceptually similar word forms. A review of the development and initial behavioral validations of computational models of visual spoken word recognition is presented, followed by a report of new empirical evidence. Specifically, a replication and extension of Mattys, Bernstein & Auer's (2002) study was conducted with 20 deaf participants who varied widely in speechreading ability. Participants visually identified isolated spoken words. Accuracy of visual spoken word recognition was influenced by the number of visually similar words in the lexicon and by the frequency of occurrence of the stimulus words. The results are consistent with the common view held within auditory word recognition that this task is accomplished via a process of activation and competition in which frequently occurring units are favored. Finally, future directions for visual spoken word recognition are discussed.     

Recency effects for meaning and form in word selection

Three experiments examined the contribution of phonological availability in selecting words as predicted by interactive activation models of word production. Homophonous words such as week and weak permitted a word's phonological form to be activated on priming trials without selection of its meaning or lemma. Recent production of a homophone failed to significantly increase production of its twin as a sentence completion. However, speakers were significantly more likely to complete a sentence with a recently read or generated unambiguous word. This increase in response probability was unaffected by word frequency. The results constrain the degree to which experience and phonological availability may affect word selection in spoken language production.     

嗓音源判断过程中的范畴效应和通道效应

该项研究通过设计4种实验条件,旨在探讨不同嗓音词的再认和嗓音判断过程各自的特点及其相互联系。4种实验条件是由2种诵读方式和2种测试方式组合而成,2种诵读方式为同范畴同嗓音和同范畴异嗓音,2种测试方式为视觉呈现和听觉呈现。52名大学生被试随机分成4个独立的组,分别接受一种实验处理。实验结果显示：(1)同范畴同嗓音条件与同范畴异嗓音条件相比,前者项目词的嗓音源判断效果好。提示增加相同记忆源项目间语义联系将有利于记忆源的检测判断。(2)项目再认与项目嗓音判断结果不完全一致,只有在诵读方式为同范畴同嗓音测试方式为听觉呈现情境下,两者有较高的正相关。(3)在同范畴同嗓音诵读条件下,再认反映出学习和测试通道源一致性优势效应,嗓音判断没有反映出通道源一致性优势效应。     

What Do Second Language Listeners Know About Spoken Words? Effects of Experience and Attention in Spoken Word Processing

With a goal of investigating psycholinguistic bases of spoken word processing in a second language (L2), this study examined L2 learners' sensitivity to phonological information in spoken L2 words as a function of their L2 experience and attentional demands of a learning task. Fifty-two Chinese learners of English who differed in amount of L2 experience (longer vs. shorter residence in L2 environment) were tested in an auditory word priming experiment on well-known L2 words under two processing orientation conditions (semantic, control). Results revealed that, with more L2 experience, learners become more sensitive to phonological detail in spoken L2 words but that attention to word meaning might eliminate this sensitivity, even for learners with more L2 experience.     

Orthographic influences in spoken word recognition: The consistency effect in semantic and gender categorization tasks

According to current models, spoken word recognition is driven by the phonological properties of the speech signal. However, several studies have suggested that orthographic information also influences recognition in adult listeners. In particular, it has been repeatedly shown that, in the lexical decision task, words that include rimes with inconsistent spellings (e.g., /-ip/ spelled -eap or -eep) are disadvantaged, as compared with words with consistent rime spelling. In the present study, we explored whether the orthographic consistency effect extends to tasks requiring people to process words beyond simple lexical access. Two different tasks were used: semantic and gender categorization. Both tasks produced reliable consistency effects. The data are discussed as suggesting that orthographic codes are activated during word recognition, or that the organization of phonological representations of words is affected by orthography during literacy acquisition.     

When do leotards get their spots? Semantic activation of lexical neighbors in visual word recognition

Shadowing and priming studies have provided strong evidence that during spoken word recognition, the meanings of different words that share their onset (e.g., captain and captive) are activated in parallel. In contrast, for visual word recognition, there is little evidence that the meanings of visually similar words are activated in parallel. This is consistent with the idea that for reading (in contrast to listening), since all the sensory information necessary to identify a word is available at once, any competition between visually similar words is resolved before their meanings are retrieved. However, Forster and Hector (2002) have recently shown that for nonwords (e.g., turple), some aspect of the meanings of lexical neighbors (e.g., turtle) can be activated. However, this finding is limited to non-words. The activation of turtle's meaning in response to turple may occur because turple has no meaning. In normal reading, we do not encounter nonwords, and there is strong pressure on the reading system to produce meaningful representations for every word (even misspelled words). The two semantic categorization experiments reported here extend this finding to real words. Participants are slower to decide that leotard is not an animal because of its animal neighbor leopard. This shows that information about a word's meaning can be available before it has been uniquely recognized.     

Communicating emotion: linking affective prosody and word meaning

The present study investigated the role of emotional tone of voice in the perception of spoken words. Listeners were presented with words that had either a happy, sad, or neutral meaning. Each word was spoken in a tone of voice (happy, sad, or neutral) that was congruent, incongruent, or neutral with respect to affective meaning, and naming latencies were collected. Across experiments, tone of voice was either blocked or mixed with respect to emotional meaning. The results suggest that emotional tone of voice facilitated linguistic processing of emotional words in an emotion-congruent fashion. These findings suggest that information about emotional tone is used in the processing of linguistic content influencing the recognition and naming of spoken words in an emotion-congruent manner.     

The spread of the phonological neighborhood influences spoken word recognition

In three experiments, the processing of words that had the same overall number of neighbors but varied in the spread of the neighborhood (i.e., the number of individual phonemes that could be changed to form real words) was examined. In an auditory lexical decision task, a naming task, and a same-different task, words in which changes at only two phoneme positions formed neighbors were responded to more quickly than words in which changes at all three phoneme positions formed neighbors. Additional analyses ruled out an account based on the computationally derived uniqueness points of the words. Although previous studies (e.g., Luce & Pisoni, 1998) have shown that the number of phonological neighbors influences spoken word recognition, the present results show that the nature of the relationship of the neighbors to the target word--as measured by the spread of the neighborhood--also influences spoken word recognition. The implications of this result for models of spoken word recognition are discussed.     

The sound of enemies and friends in the neighborhood

Previous studies (e.g., Pecher, Zeelenberg, & Wagenmakers, 2005) found that semantic classification performance is better for target words with orthographic neighbors that are mostly from the same semantic class (e.g., living) compared to target words with orthographic neighbors that are mostly from the opposite semantic class (e.g., nonliving). In the present study we investigated the contribution of phonology to orthographic neighborhood effects by comparing effects of phonologically congruent orthographic neighbors (book-hook) to phonologically incongruent orthographic neighbors (sand-wand). The prior presentation of a semantically congruent word produced larger effects on subsequent animacy decisions when the previously presented word was a phonologically congruent neighbor than when it was a phonologically incongruent neighbor. In a second experiment, performance differences between target words with versus without semantically congruent orthographic neighbors were larger if the orthographic neighbors were also phonologically congruent. These results support models of visual word recognition that assume an important role for phonology in cascaded access to meaning.     

“Passion” versus “patience”: the effects of valence and arousal on constructive word recognition

Accumulating evidence suggests that emotional information is often recognised faster than neutral information. Several studies examined the effects of valence and arousal on word recognition, but yielded partially diverging results. Here, we used two alternative versions of a constructive recognition paradigm in which a target word is hidden by a visual mask that gradually disappears, to investigate whether the emotional properties of words influence their speed of recognition. Participants were instructed either to classify the incrementally appearing word as emotional or non-emotional (semantic categorisation task) or to decide whether the appearing letter string is an existing word or not (lexical decision task). Results from both tasks revealed faster recognition times for high- compared to low-arousing words, and for positive compared to negative or neutral words. These findings indicate a recognition advantage for emotionally positive and highly arousing stimuli that persists even when visual word recognition is hampered and participants are encouraged to make more active, semantic inferences to generate the meaning of the emerging word.     

Early effects of neighborhood density and phonotactic probability of spoken words on event-related potentials

All current models of spoken word recognition propose that sound-based representations of spoken words compete with, or inhibit, one another during recognition. In addition, certain models propose that higher probability sublexical units facilitate recognition under certain circumstances. Two experiments were conducted examining ERPs to spoken words and nonwords simultaneously varying in phonotactic probability and neighborhood density. Results showed that the amplitude of the P2 potential was greater for high probability-density words and nonwords, suggesting an early inhibitory effect of neighborhood density. In order to closely examine the role of phonotactic probability, effects of initial phoneme frequency were also examined. The latency of the P2 potential was shorter for words with high initial-consonant probability, suggesting a facilitative effect of phonotactic probability. The current results are consistent with findings from previous studies using reaction time and eye-tracking paradigms and provide new insights into the time-course of lexical and sublexical activation and competition.     

Cross-modal working memory binding and L1-L2 word learning

The ability to create temporary binding representations of information from different sources in working memory has recently been found to relate to the development of monolingual word recognition in children. The current study explored this possible relationship in an adult word-learning context. We assessed whether the relationship between cross-modal working memory binding and lexical development would be observed in the learning of associations between unfamiliar spoken words and their semantic referents, and whether it would vary across experimental conditions in first- and second-language word learning. A group of English monolinguals were recruited to learn 24 spoken disyllable Mandarin Chinese words in association with either familiar or novel objects as semantic referents. They also took a working memory task in which their ability to temporarily bind auditory-verbal and visual information was measured. Participants’ performance on this task was uniquely linked to their learning and retention of words for both novel objects and for familiar objects. This suggests that, at least for spoken language, cross-modal working memory binding might play a similar role in second language-like (i.e., learning new words for familiar objects) and in more native-like situations (i.e., learning new words for novel objects). Our findings provide new evidence for the role of cross-modal working memory binding in L1 word learning and further indicate that early stages of picture-based word learning in L2 might rely on similar cognitive processes as in L1.