The influence of speech rate and accent on access and use of semantic information

Circumstances in which the speech input is presented in sub-optimal conditions generally lead to processing costs affecting spoken word recognition. The current study indicates that some processing demands imposed by listening to difficult speech can be mitigated by feedback from semantic knowledge. A set of lexical decision experiments examined how foreign accented speech and word duration impact access to semantic knowledge in spoken word recognition. Results indicate that when listeners process accented speech, the reliance on semantic information increases. Speech rate was not observed to influence semantic access, except in the setting in which unusually slow accented speech was presented. These findings support interactive activation models of spoken word recognition in which attention is modulated based on speech demands.     

On the Nature of Semantic Constraints on Lexical Access

We present two eye-tracking experiments that investigate lexical frequency and semantic context constraints in spoken-word recognition in German. In both experiments, the pivotal words were pairs of nouns overlapping at onset but varying in lexical frequency. In Experiment 1, German listeners showed an expected frequency bias towards high-frequency competitors (e.g., Blume, 'flower') when instructed to click on low-frequency targets (e.g., Bluse, 'blouse'). In Experiment 2, semantically constraining context increased the availability of appropriate low-frequency target words prior to word onset, but did not influence the availability of semantically inappropriate high-frequency competitors at the same time. Immediately after target word onset, however, the activation of high-frequency competitors was reduced in semantically constraining sentences, but still exceeded that of unrelated distractor words significantly. The results suggest that (1) semantic context acts to downgrade activation of inappropriate competitors rather than to exclude them from competition, and (2) semantic context influences spoken-word recognition, over and above anticipation of upcoming referents.     

Effects of shadowing on prose comprehension and problem solving

In two experiments, subjects listened to a text about radar while either shadowing or not shadowing the passage. Results of Experiment 1 produced a pattern in which both groups performed at similar levels on retention of single facts, the nonshadowers excelled on transfer of the presented information to novel problem solving, and shadowers excelled on verbatim recognition of words. In Experiment 2, there was a pattern in which both groups performed at similar levels for recall of specific information, the nonshadowers excelled on recall of conceptual principles, and shadowers excelled on recall of modifying details. Implications for transfer-appropriate processing and the cognitive capacity hypothesis were examined.     

Functional constraints on sentence processing: A cross-linguistic study

English and Italian provide some interesting contrasts that are relevant to a controversial problem in psycholinguistics: the boundary between grammatical and extra-grammatical knowledge in sentence processing. Although both are SVO word order languages without case inflections to indicate basic grammatical relations, Italian permits far more variation in word order for pragmatic purposes. Hence Italians must rely more than English listeners on factors other than word order. In this experiment, Italian and English adults were asked to interpret 81 simple sentences varying word order, animacy contrasts between the two nouns, topicalization and contrastive stress. Italians relied primarily on semantic strategies while the English listeners relied on word order—including a tendency to interpret the second noun as subject in non-canonical word orders (corresponding to word order variations in informal English production). Italians also made greater use of topic and stress information. Finally, Italians were much slower and less consistent in the application of word order strategies even for reversible NVN sentences where there was no conflict between order and semantics. This suggests that Italian is ‘less’ of an SVO language than English. Semantic strategies apparently stand at the ‘core’ of Italian to the same extent that word order stands at the ‘core’ of English. It is suggested that these results pose problems for claims about a ‘universal’ separation between semantics and syntax, and for theories that postulate a ‘universal’ priority of one type of information over another. Results are discussed in the light of the competition model, a functionalist approach to grammar that accounts in a principled way for probabilistic outcomes and differential ‘weights’ among competing and converging sources of information in sentence processing.     

Effects of sentential stress and word class upon comprehension in Broca's aphasics

The roles which word class (open/closed) and sentential stress play in the sentence comprehension processes of both agrammatic (Broca's) aphasics and normal listeners were examined with a word monitoring task. Overall, normal listeners responded more quickly to stressed than to unstressed items, but showed no effect of word class. Aphasics also responded more quickly to stressed than to unstressed materials, but, unlike the normals, responded faster to open than to closed class words regardless of their stress. The results are interpreted as support for the theory that Broca's aphasics lack the functional underlying open/closed class word distinction used in word recognition by normal listeners.     

To What Extent do we Hear Phonemic Contrasts in a Non-native Regional Variety? Tracking the Dynamics of Perceptual Processing with EEG

This combined ERP and behavioral experiment explores the dynamics of processing during the discrimination of vowels in a non-native regional variety. Southern listeners were presented with three word forms, two of which are encountered in both Standard and Southern French ([kot] and [kut]), whereas the third one exists in Standard but not Southern French ([kot]). EEG recordings suggest that all of the word pairs were discriminated by the listeners, although discrimination arose about 100ms later for the pairs which included the non-native word form than for those which contained word forms common to both French varieties. Behavioral data provide evidence that vowel discrimination is sensitive to the influence of the listeners’ native phonemic inventory at a late decisional stage of processing.     

How does familiarity with a voice affect trait judgements?

From only a single spoken word, listeners can form a wealth of first impressions of a person’s character traits and personality based on their voice. However, due to the substantial within-person variability in voices, these trait judgements are likely to be highly stimulus-dependent for unfamiliar voices: The same person may sound very trustworthy in one recording but less trustworthy in another. How trait judgements differ when listeners are familiar with a voice is unclear: Are listeners who are familiar with the voices as susceptible to the effects of within-person variability? Does the semantic knowledge listeners have about a familiar person influence their judgements? In the current study, we tested the effect of familiarity on listeners’ trait judgements from variable voices across 3 experiments. Using a between-subjects design, we contrasted trait judgements by listeners who were familiar with a set of voices – either through laboratory-based training or through watching a TV show – with listeners who were unfamiliar with the voices. We predicted that familiarity with the voices would reduce variability in trait judgements for variable voice recordings from the same identity (cf. Mileva, Kramer & Burton, Perception, 48, 471 and 2019, for faces). However, across the 3 studies and two types of measures to assess variability, we found no compelling evidence to suggest that trait impressions were systematically affected by familiarity.     

Effects of talker, rate, and amplitude variation on recognition memory for spoken words

This study investigated the encoding of the surface form of spoken words using a continuous recognition memory task. The purpose was to compare and contrast three sources of stimulus variability--talker, speaking rate, and overall amplitude--to determine the extent to which each source of variability is retained in episodic memory. In Experiment 1, listeners judged whether each word in a list of spoken words was "old" (had occurred previously in the list) or "new." Listeners were more accurate at recognizing a word as old if it was repeated by the same talker and at the same speaking rate; however, there was no recognition advantage for words repeated at the same overall amplitude. In Experiment 2, listeners were first asked to judge whether each word was old or new, as before, and then they had to explicitly judge whether it was repeated by the same talker, at the same rate, or at the same amplitude. On the first task, listeners again showed an advantage in recognition memory for words repeated by the same talker and at same speaking rate, but no advantage occurred for the amplitude condition. However, in all three conditions, listeners were able to explicitly detect whether an old word was repeated by the same talker, at the same rate, or at the same amplitude. These data suggest that although information about all three properties of spoken words is encoded and retained in memory, each source of stimulus variation differs in the extent to which it affects episodic memory for spoken words.     

Inhibitory processes and spoken word recognition in young and older adults: the interaction of lexical competition and semantic context.

Two experiments were conducted to examine the importance of inhibitory abilities and semantic context to spoken word recognition in older and young adults. In Experiment 1, identification scores were obtained in 3 contexts: single words, low-predictability sentences, and high-predictability sentences. Additionally, identification performance was examined as a function of neighborhood density (number of items phonetically similar to a target word). Older adults had greater difficulty than young adults recognizing words with many neighbors (hard words). However, older adults also exhibited greater benefits as a result of adding contextual information. Individual differences in inhibitory abilities contributed significantly to recognition performance for lexically hard words but not for lexically easy words. The roles of inhibitory abilities and linguistic knowledge in explaining age-related impairments in spoken word recognition are discussed.     

Orthographic influences in spoken word recognition: The consistency effect in semantic and gender categorization tasks

According to current models, spoken word recognition is driven by the phonological properties of the speech signal. However, several studies have suggested that orthographic information also influences recognition in adult listeners. In particular, it has been repeatedly shown that, in the lexical decision task, words that include rimes with inconsistent spellings (e.g., /-ip/ spelled -eap or -eep) are disadvantaged, as compared with words with consistent rime spelling. In the present study, we explored whether the orthographic consistency effect extends to tasks requiring people to process words beyond simple lexical access. Two different tasks were used: semantic and gender categorization. Both tasks produced reliable consistency effects. The data are discussed as suggesting that orthographic codes are activated during word recognition, or that the organization of phonological representations of words is affected by orthography during literacy acquisition.     

The picture superiority effect in a cross-modality recognition task

Words and pictures were studied, and recognition tests were given in which each studied object was to be recognized in both word and picture format. The main dependent variable was the latency of the recognition decision. The purpose was to investigate the effects of study modality (word or picture), of congruence between study and test modalities, and of priming resulting from repeated testing. Experiments 1 and 2 used the same basic design, but the latter also varied retention interval. Experiment 3 added a manipulation of instructions to name studied objects, and Experiment 4 deviated from the others by presenting both picture and word referring to the same object together for study. The results showed that congruence between study and test modalities consistently facilitated recognition. Furthermore, items studied as pictures were more rapidly recognized than were items studied as words. With repeated testing, the second instance was affected by its predecessor, but the facilitating effect of picture-to-word priming exceeded that of word-to-picture priming. The findings suggest a two-stage recognition process, in which the first is based on perceptual familiarity and the second uses semantic links for a retrieval search. Common-code theories that grant privileged access to the semantic code for pictures or, alternatively, dual-code theories that assume mnemonic superiority for the image code are supported by the findings. Explanations of the picture superiority effect as resulting from dual encoding of pictures are not supported by the data.     

Working memory affects older adults’ use of context in spoken-word recognition

Many older listeners report difficulties in understanding speech in noisy situations. Working memory and other cognitive skills may modulate older listeners’ ability to use context information to alleviate the effects of noise on spoken-word recognition. In the present study, we investigated whether verbal working memory predicts older adults’ ability to immediately use context information in the recognition of words embedded in sentences, presented in different listening conditions. In a phoneme-monitoring task, older adults were asked to detect as fast and as accurately as possible target phonemes in sentences spoken by a target speaker. Target speech was presented without noise, with fluctuating speech-shaped noise, or with competing speech from a single distractor speaker. The gradient measure of contextual probability (derived from a separate offline rating study) affected the speed of recognition. Contextual facilitation was modulated by older listeners’ verbal working memory (measured with a backward digit span task) and age across listening conditions. Working memory and age, as well as hearing loss, were also the most consistent predictors of overall listening performance. Older listeners’ immediate benefit from context in spoken-word recognition thus relates to their ability to keep and update a semantic representation of the sentence content in working memory.     

Rapid processing of the meaning of sentences

It has been shown (Fischler & Bloom, 1979) that sentence contexts facilitate a lexical decision task for words that are highly likely sentence completions and inhibit the decision for words that are semantically anomalous sentence completions. In the present experiment, the sentence contexts were presented 1 word at a time, at rates from 4 to 28 words/sec. The facilitation for words that were likely sentence completions was marginal at the slower rates and absent at higher rates. In contrast, the inhibitory effects of semantic anomaly were apparent at all presentation rates. Several analyses suggested that the sentence contexts were becoming ineffective at the very highest presentation rates, but the high rates at which the sentence contexts still affected word recognition were taken as evidence that semantic information accrues at an early stage of sentence processing. Implications for Posner and Snyder’s (1975) theory of attention and for models of reading were discussed.     

Accent modulates access to word meaning: Evidence for a speaker-model account of spoken word recognition

Speech carries accent information relevant to determining the speaker’s linguistic and social background. A series of web-based experiments demonstrate that accent cues can modulate access to word meaning. In Experiments 1–3, British participants were more likely to retrieve the American dominant meaning (e.g., hat meaning of “bonnet”) in a word association task if they heard the words in an American than a British accent. In addition, results from a speeded semantic decision task (Experiment 4) and sentence comprehension task (Experiment 5) confirm that accent modulates on-line meaning retrieval such that comprehension of ambiguous words is easier when the relevant word meaning is dominant in the speaker’s dialect. Critically, neutral-accent speech items, created by morphing British- and American-accented recordings, were interpreted in a similar way to accented words when embedded in a context of accented words (Experiment 2). This finding indicates that listeners do not use accent to guide meaning retrieval on a word-by-word basis; instead they use accent information to determine the dialectic identity of a speaker and then use their experience of that dialect to guide meaning access for all words spoken by that person. These results motivate a speaker-model account of spoken word recognition in which comprehenders determine key characteristics of their interlocutor and use this knowledge to guide word meaning access.     

The tool for the automatic analysis of lexical sophistication (TAALES): version 2.0

This study introduces the second release of the Tool for the Automatic Analysis of Lexical Sophistication (TAALES 2.0), a freely available and easy-to-use text analysis tool. TAALES 2.0 is housed on a user’s hard drive (allowing for secure data processing) and is available on most operating systems (Windows, Mac, and Linux). TAALES 2.0 adds 316 indices to the original tool. These indices are related to word frequency, word range, n-gram frequency, n-gram range, n-gram strength of association, contextual distinctiveness, word recognition norms, semantic network, and word neighbors. In this study, we validated TAALES 2.0 by investigating whether its indices could be used to model both holistic scores of lexical proficiency in free writes and word choice scores in narrative essays. The results indicated that the TAALES 2.0 indices could be used to explain 58% of the variance in lexical proficiency scores and 32% of the variance in word-choice scores. Newly added TAALES 2.0 indices, including those related to n-gram association strength, word neighborhood, and word recognition norms, featured heavily in these predictor models, suggesting that TAALES 2.0 represents a substantial upgrade.     

The semantics of prosody: acoustic and perceptual evidence of prosodic correlates to word meaning

This investigation examined whether speakers produce reliable prosodic correlates to meaning across semantic domains and whether listeners use these cues to derive word meaning from novel words. Speakers were asked to produce phrases in infant-directed speech in which novel words were used to convey one of two meanings from a set of antonym pairs (e.g., big/small). Acoustic analyses revealed that some acoustic features were correlated with overall valence of the meaning. However, each word meaning also displayed a unique acoustic signature, and semantically related meanings elicited similar acoustic profiles. In two perceptual tests, listeners either attempted to identify the novel words with a matching meaning dimension (picture pair) or with mismatched meaning dimensions. Listeners inferred the meaning of the novel words significantly more often when prosody matched the word meaning choices than when prosody mismatched. These findings suggest that speech contains reliable prosodic markers to word meaning and that listeners use these prosodic cues to differentiate meanings. That prosody is semantic suggests a reconceptualization of traditional distinctions between linguistic and nonlinguistic properties of spoken language.     

Automatic and strategic effects in semantic priming: An examination of Becker’s verification model

Becker’s (1980) verification model, in conjunction with a two-strategy hypothesis, is cited as an alternative to a dual-process model (e.g., Posner & Snyder, 1975) of word recognition and semantic priming. Becket’s approach suggests that individuals can use either an “expectancy” or a “prediction” strategy in word recognition, and maintains that the verification model successfully predicts certain patterns of facilitation and inhibition in a semantic priming task that a dual-process model cannot. The present study demonstrated that when a long stimulus-onset asynchrony (SOA = 1,000 msec) is used between prime and target, support is given to Becker’s findings, and to the verification model approach. However, at a short SOA (200 msec), no evidence is found for the hypothesized difference between strategic processes. The results are consistent with other findings (e.g., Neely, 1977) in showing that strategic factors in semantic priming are largely inoperative at short prime-target SOAs, and suggests that Becker’s model is not general enough to rule out some type of dual-process model.     

Toddlers recognize words in an unfamiliar accent after brief exposure

Both subjective impressions and previous research with monolingual listeners suggest that a foreign accent interferes with word recognition in infants, young children, and adults. However, because being exposed to multiple accents is likely to be an everyday occurrence in many societies, it is unexpected that such non‐standard pronunciations would significantly impede language processing once the listener has experience with the relevant accent. Indeed, we report that 24‐month‐olds successfully accommodate an unfamiliar accent in rapid word learning after less than 2 minutes of accent exposure. These results underline the robustness of our speech perception mechanisms, which allow listeners to adapt even in the absence of extensive lexical knowledge and clear known‐word referents. A video abstract of this article can be viewed at http: ? ?www.youtube.com ?watch?v=bYnaZkMyKtY&feature=youtu.be     

Word-Monitoring Tasks Interact with Levels of Representation During Speech Comprehension

Researchers frequently use data from monitoring tasks to argue that constraints on meaning facilitate lower-level processes. An alternate hypothesis is that the processing level that a monitoring task requires interacts with discourse-level processing. Subjects monitored spoken sentences for a synonym (semantic match), a nonsense word (phonological match), or a rhyme (phonologically and semantically constrained matching). The critical targets appeared at the beginning of the final clause in two-clause sentences that began with if, which signals a semantic analysis at the discourse level, or with though, which maintains a surface representation. Synonym-monitoring times were faster for if than for though, nonsense word-monitoring times were faster for though than for if, and rhyme-monitoring times did not differ for if and though. The results show that conjunctions influence how listeners allocate attention to semantic versus phonological information, implying that listeners form these kinds of information independently.     

Physical features vs meaning: A difference in decay

The encoding of either physical or semantic features of words was biased in an intentional learning situation. A modified recognition test was then employed to assess the effectiveness of this study manipulation and its consequences for retention. The Ss were required to select test items that were either physically similar, semantically similar, or identical to a study word. Results revealed that Ss biased toward physical encoding were more successful in selecting physically similar than semantically similar test items, while the opposite was true of Ss biased toward semantic encoding. The Ss in the two study conditions did not differ in their ability to select test items that were identical to a study word. This pattern of results was interpreted as evidence that semantic and physical information can be equally well retained over the long term. Limits on the generality of prior findings of rapid decay for physical information are discussed.