Representation and competition in the perception of spoken words

We present data from four experiments using cross-modal priming to examine the effects of competitor environment on lexical activation during the time course of the perception of a spoken word. The research is conducted from the perspective of a distributed model of speech perception and lexical representation, which focuses on activation at the level of lexical content. In this model, the strength of competition between simultaneously active lexical items depends on the degree of coherence between their distributed semantic and phonological representations. Consistent with this model, interference effects are more complete when the purely semantic aspects of these coactive representations are probed (using semantic priming) than when phonological aspects are probed as well (using repetition priming).     

Deficits in lexical and semantic processing: implications for models of normal language

The investigation of language processing following brain damage may be used to constrain models of normal language processing. We review the literature on semantic and lexical processing deficits, focusing on issues of representation of semantic knowledge and the mechanisms of lexical access. The results broadly support a componential organization of lexical knowledge—the semantic component is independent of phonological and orthographic form knowledge, and the latter are independent of each other. Furthermore, the results do not support the hypothesis that word meaning is organized into modality-specific subcomponents. We also discuss converging evidence from functional imaging studies in relation to neuropsychological results.     

Reduced short-term memory capacity in Alzheimer's disease: The role of phonological,lexical, and semantic processing

Individuals with Alzheimer's disease (AD) are often reported to have reduced verbal short-term memory capacity, typically attributed to their attention/executive deficits. However, these individuals also tend to show progressive impairment of semantic, lexical, and phonological processing which may underlie their low short-term memory capacity. The goals of this study were to assess the contribution of each level of representation (phonological, lexical, and semantic) to immediate serial recall performance in 18 individuals with AD, and to examine how these linguistic effects on short-term memory were modulated by their reduced capacity to manipulate information in short-term memory associated with executive dysfunction. Results showed that individuals with AD had difficulty recalling items that relied on phonological representations, which led to increased lexicality effects relative to the control group. This finding suggests that patients have a greater reliance on lexical/semantic information than controls, possibly to make up for deficits in retention and processing of phonological material. This lexical/semantic effect was not found to be significantly correlated with patients’ capacity to manipulate verbal material in short-term memory, indicating that language processing and executive deficits may independently contribute to reducing verbal short-term memory capacity in AD.     

Studying the grammatical aspects of word recognition: lexical priming,parsing, and syntactic ambiguity resolution

Two experiments are reported examining the relationship between lexical and syntactic processing during language comprehension, combining techniques common to the on-line study of syntactic ambiguity resolution with priming techniques common to the study of lexical processing. By manipulating grammatical properties of lexical primes, we explore how lexically based knowledge is activated and guides combinatory sentence processing. Particularly, we find that nouns (like verbs, see Trueswell & Kim, 1998) can activate detailed lexically specific syntactic information and that these representations guide the resolution of relevant syntactic ambiguities pertaining to verb argument structure. These findings suggest that certain principles of knowledge representation common to theories of lexical knowledge—such as overlapping and distributed representations—also characterize grammatical knowledge. Additionally, observations from an auditory comprehension study suggest similar conclusions about the lexical nature of parsing in spoken language comprehension. They also suggest that thematic role and syntactic preferences are activated during word recognition and that both influence combinatory processing.     

Reduced short-term memory capacity in Alzheimer's disease: the role of phonological, lexical, and semantic processing

Individuals with Alzheimer's disease (AD) are often reported to have reduced verbal short-term memory capacity, typically attributed to their attention/executive deficits. However, these individuals also tend to show progressive impairment of semantic, lexical, and phonological processing which may underlie their low short-term memory capacity. The goals of this study were to assess the contribution of each level of representation (phonological, lexical, and semantic) to immediate serial recall performance in 18 individuals with AD, and to examine how these linguistic effects on short-term memory were modulated by their reduced capacity to manipulate information in short-term memory associated with executive dysfunction. Results showed that individuals with AD had difficulty recalling items that relied on phonological representations, which led to increased lexicality effects relative to the control group. This finding suggests that patients have a greater reliance on lexical/semantic information than controls, possibly to make up for deficits in retention and processing of phonological material. This lexical/semantic effect was not found to be significantly correlated with patients' capacity to manipulate verbal material in short-term memory, indicating that language processing and executive deficits may independently contribute to reducing verbal short-term memory capacity in AD.     

Representing word meaning and order information in a composite holographic lexicon

The authors present a computational model that builds a holographic lexicon representing both word meaning and word order from unsupervised experience with natural language. The model uses simple convolution and superposition mechanisms (cf. B. B. Murdock, 1982) to learn distributed holographic representations for words. The structure of the resulting lexicon can account for empirical data from classic experiments studying semantic typicality, categorization, priming, and semantic constraint in sentence completions. Furthermore, order information can be retrieved from the holographic representations, allowing the model to account for limited word transitions without the need for built-in transition rules. The model demonstrates that a broad range of psychological data can be accounted for directly from the structure of lexical representations learned in this way, without the need for complexity to be built into either the processing mechanisms or the representations. The holographic representations are an appropriate knowledge representation to be used by higher order models of language comprehension, relieving the complexity required at the higher level.     

Phonologically related lexical repetition disorder: a case study

Errors of repetition in aphasia are most often nonword substitutions. Phonologically related lexical errors, or formal errors, are real-word substitutions that overlap with target words in sound. In the present research we present the case of an aphasic patient, MMB, who produced an unusually high rate of formal paraphasias in repetition. Six experiments were conducted to investigate the combination of impairments contributing to MMB's pattern of repetition and to test the predictions made by two theories of formal errors. MMB's formal errors in repetition were influenced by target frequency, but not by target length or imageability. Formal errors tended to be more frequent than their targets and showed greatest phonological overlap with targets at initial consonant. These findings provided partial support for Martin and Saffran's fully interactive spreading activation account of formal errors and did not support Blanken's phonological interactive encoding account. In Experiment 6, the effect on repetition of increasing auditory verbal short-term memory (AVSTM) demands was examined using a paired word repetition experiment. Under these conditions, MMB produced semantic paraphasias for the first time, providing strong support for the Martin-Saffran hypothesis that phonologically related, and semantic, lexical repetition disorders lie on a continuum of severity moderated by the degree of AVSTM impairment.     

Interaction and representational integration: evidence from speech errors

We examine the mechanisms that support interaction between lexical, phonological and phonetic processes during language production. Studies of the phonetics of speech errors have provided evidence that partially activated lexical and phonological representations influence phonetic processing. We examine how these interactive effects are modulated by lexical frequency. Previous research has demonstrated that during lexical access, the processing of high frequency words is facilitated; in contrast, during phonetic encoding, the properties of low frequency words are enhanced. These contrasting effects provide the opportunity to distinguish two theoretical perspectives on how interaction between processing levels can be increased. A theory in which cascading activation is used to increase interaction predicts that the facilitation of high frequency words will enhance their influence on the phonetic properties of speech errors. Alternatively, if interaction is increased by integrating levels of representation, the phonetics of speech errors will reflect the retrieval of enhanced phonetic properties for low frequency words. Utilizing a novel statistical analysis method, we show that in experimentally induced speech errors low lexical frequency targets and outcomes exhibit enhanced phonetic processing. We sketch an interactive model of lexical, phonological and phonetic processing that accounts for the conflicting effects of lexical frequency on lexical access and phonetic processing.     

A computational account of deep dysphasia: evidence from a single case study.

We present a case study of a patient, NC, who demonstrates the defining characteristics of deep dysphasia including semantic errors in repetition and an inability to repeat nonwords. In addition, NC's single word repetition and lexical decision performances are influenced by the imageability of the word input. NC also demonstrates a severely restricted phonological short-term memory (one digit, one word). Although his phonological discrimination is good in a minimal pairs judgment task, it becomes impaired when a delay is imposed or rehearsal is prevented between presentation of each member of a pair. NC's output is fluent but contains many formal paraphasias and neologisms. NC's total language profile is evaluated within the framework of Dell's (1986) interactive spreading activation model of language production. Adapting this output model to input processes, we account for all of NC's deep dysphasic symptoms as well as his pattern of production in a way that is more parsimonious than other attempts to model this disorder. In particular, we suggest that the semantic and formal paraphasias in naming and repetition result from a pathological increase in the rate of decay of primed nodes in the semantic-lexical-phonological network. This rapid decay increases the probability that phonologically and/or semantically related lexical nodes primed by top-down and bottom-up feedback during the operation of lexical activation and retrieval will be activated and selected instead of the lexical target. The advantages of using this model to account for aphasic symptoms and the implications for other lexical theories are discussed.     

Analysis of word comprehension in a case of pure word deafness

A case of pure word deafness due to a left temporal infarct is reported. The results of dichotic tests suggest that auditory verbal material may be processed in the right hemisphere. The inability to repeat nonsense words, the frequent semantic paraphasias in real-word repetition tasks, and the capacity to give a partial account of the meaning of a word that the patient cannot repeat show that despite the impairment of the phonological analysis, lexical semantic processing is possible. An attempt is made to demonstrate that the patient resorts to this semantic processing and that this reflects the linguistic competence of the right hemisphere.     

The neuropsychology of writing and spelling: semantic, phonological, motor, and perceptual processes

Neuropsychological data is reviewed in order to delineate the semantic, phonological, motor, and perceptual processes underlying spelling, with particular attention to handwriting. These data support a model in which semantic, lexical phonological, and non-lexical phonological processes can generate spelling, either independently or in an interactive fashion. Oral and written spelling depend upon common processes up to, and including, an orthographic code. After this point they each depend upon several separate stages of information processing.     

言语产生的同音词表征：模型争论与再思

言语产生和言语理解都涉及同音词在通达过程的表征。言语产生研究中,Levelt和Caramazza分别从通达的两阶段分离激活和独立网络模型推出了同音词的分享和独立表征模型,并用语言实验的频率效应和病人的语音治疗效应给予检验。本文评述了研究的新进展,探讨了同音词表征模型的分歧,认为同音词词汇表征与语言差异、加工范式、知觉通道等有关。从言语理解（言语知觉和词汇再认）的研究表明,这两种表征模型可能难以概括同音词尤其是汉语同音词的表征。本文根据言语理解研究的新近发现建议了一些可能的表征模型。     

Graded semantic and phonological similarity effects in priming: evidence for a distributed connectionist approach to morphology

A considerable body of empirical and theoretical research suggests that morphological structure governs the representation of words in memory and that many words are decomposed into morphological components in processing. The authors investigated an alternative approach in which morphology arises from the interaction of semantic and phonological codes. A series of cross-modal lexical decision experiments shows that the magnitude of priming reflects the degree of semantic and phonological overlap between words. Crucially, moderately similar items produce intermediate facilitation (e.g., lately-late). This pattern is observed for word pairs exhibiting different types of morphological relationships, including suffixed-stem (e.g., teacher-teach), suffixed-suffixed (e.g., saintly-sainthood), and prefixed-stem pairs (preheat-heat). The results can be understood in terms of connectionist models that use distributed representations rather than discrete morphemes.     

The Influence of Native-language Phonology on Lexical Access: Exemplar-Based Versus Abstract Lexical Entries

This study used medium-term auditory repetition priming to investigate word-recognition processes. Highly fluent Catalan-Spanish bilinguals whose first language was either Catalan or Spanish were tested in a lexical decision task involving Catalan words and nonwords. Spanish-dominant individuals, but not Catalan-dominant individuals, exhibited repetition priming for minimal pairs differing in only one feature that is nondistinctive in Spanish (e.g., /net@/ vs. /nEt@/), thereby indicating that they processed these words as homophones. This finding provides direct evidence both that word recognition uses a language-specific phonological representation and that lexical entries are stored in the mental lexicon as abstract forms.     

Transcortical sensory aphasia: Evidence for subtypes

Impaired auditory comprehension and fluent but semantically empty speech in conjunction with preserved repetition characterize the syndrome of transcortical sensory aphasia (TSA). Repetition, however, may be mediated by at least two distinct processes--a lexical process that may involve the recognition and subsequent activation of discrete stored word representations and a nonlexical process that involves phonologic decoding and immediate phonologic encoding from immediate memory. We investigated the spontaneous speech, reading, and tendency to recognize and spontaneously correct syntactic errors in four patients with TSA: this analysis suggests there are two subtypes of TSA. We contend that in one subtype both the lexical and direct repetition (or speech production) mechanisms are preserved, but in the second subtype the lexical mechanism is disrupted and repetition is mediated by the nonlexical mechanism.     

Quantifying the Interplay of Semantics and Phonology During Failures of Word Retrieval by People With Aphasia Using a Multiplex Lexical Network

Investigating instances where lexical selection fails can lead to deeper insights into the cognitive machinery and architecture supporting successful word retrieval and speech production. In this paper, we used a multiplex lexical network approach that combines semantic and phonological similarities among words to model the structure of the mental lexicon. Network measures at different levels of analysis (degree, network distance, and closeness centrality) were used to investigate the influence of network structure on picture naming accuracy and errors by people with Anomic, Broca's, Conduction, and Wernicke's aphasia. Our results reveal that word retrieval is influenced by the multiplex lexical network structure in at least two ways—(a) the accuracy of production and error type on incorrect productions were influenced by the degree and closeness centrality of the target word, and (b) error type also varied in terms of network distance between the target word and produced error word. Taken together, the analyses demonstrate that network science techniques, particularly the use of the multiplex lexical network to simultaneously represent semantic and phonological relationships among words, reveal how the structure of the mental lexicon influences language processes beyond traditionally examined psycholinguistic variables. We propose a framework for how the multiplex lexical network approach allows for understanding the influence of mental lexicon structure on word retrieval processes, with an eye toward a better understanding of the nature of clinical impairments, like aphasia.     

Intensive training of phonological skills in progressive aphasia: a model of brain plasticity in neurodegenerative disease

Three patients with a typical syndrome of nonfluent primary progressive aphasia (Mesulam's syndrome) were trained daily with a remediation protocol including auditory exercises specifically designed to involve several aspects of phonological processing, a domain known to be specifically affected in the condition. The speech content of the exercises was based on the temporal theory of phonological processes according to which increasing the duration of formant transition should facilitate phoneme discrimination and phoneomic awareness. Significantly improved performance on the trained tasks was demonstrated in the three patients. Improvement further generalized to other tasks such as nonword repetition and reading. We conclude that such results (1) argue for using intensive focused therapy of language impairment in neurodegenerative disorders, (2) may constitute a good model of brain plasticity in neurodegenerative disorders in general, and (3) support theories of phonological processing emphasizing temporal features of the auditory signal.     

The Hebb repetition effect as a laboratory analogue of novel word learning

The present study tests the hypothesis that a common ordering mechanism underlies both short-term serial recall of verbal materials and the acquisition of novel long-term lexical representations, using the Hebb repetition effect. In the first experiment, participants recalled visually presented nonsense syllables following a typical Hebb effect learning protocol. Replicating the Hebb repetition effect, we observed improved recall for repeated sequences of syllables. In the second experiment, the same participants performed an auditory lexical decision task, which included nonwords that were constructed from the syllables used in the first experiment. We observed inhibited rejection of nonwords that were composed of the repeated Hebb sequences, compared to nonwords that were built from nonrepeated filler sequences. This suggests that a long-term phonological lexical representation developed during Hebb learning. Accordingly, the relation between immediate serial recall and word learning is made explicit by arguing that the Hebb repetition effect is a laboratory analogue of naturalistic vocabulary acquisition.     

The Hebb repetition effect as a laboratory analogue of novel word learning

The present study tests the hypothesis that a common ordering mechanism underlies both short-term serial recall of verbal materials and the acquisition of novel long-term lexical representations, using the Hebb repetition effect. In the first experiment, participants recalled visually presented nonsense syllables following a typical Hebb effect learning protocol. Replicating the Hebb repetition effect, we observed improved recall for repeated sequences of syllables. In the second experiment, the same participants performed an auditory lexical decision task, which included nonwords that were constructed from the syllables used in the first experiment. We observed inhibited rejection of nonwords that were composed of the repeated Hebb sequences, compared to nonwords that were built from nonrepeated filler sequences. This suggests that a long-term phonological lexical representation developed during Hebb learning. Accordingly, the relation between immediate serial recall and word learning is made explicit by arguing that the Hebb repetition effect is a laboratory analogue of naturalistic vocabulary acquisition.     

The effects of phonological similarity on the semantic categorisation of pictorial and lexical stimuli: evidence from continuous behavioural measures

Behavioural and neuroimaging studies provide evidence of automatic activation of phonology (e.g., covert speech) during the recognition of lexical stimuli. Implicit processing of phonological information was investigated in a kinematic study of semantic categorisation of pictures (session A) or words (session B). Participants clicked one of two items (target and distractor) based on their semantic congruency (artefact or natural) with a cued-word. Phonological similarity between cued-word and distractor was varied. The presence of the phonological distractor produced trajectories with greater curvature towards the competing semantic category than did the presence of a distractor not phonologically related. This suggests that the semantic categorisation of pictorial and lexical stimuli is influenced by the automatic activation of phonological information. Trajectories’ curvature reveals competition between partially activated phonological and semantic representations suggesting that phonological codes involved in linguistic processing influence the dynamic competition underlying the semantic categorisation of lexical and pictorial.